Skip to content

FAQ

Enterprise dataset questions from AI labs

These are the questions data acquisition, research and legal teams at AI labs ask most about enterprise training data: what a dataset should contain, which format to use, how to verify de-identification, what documentation to demand, what the AI Act requires, exclusivity, RL use and how to request a dataset here.

Three people in a darkened meeting room reviewing evaluation charts on a wall screen, one pointing at a result

For AI labs and data teams

Short answers

What should an enterprise training dataset contain?

Complete records in a documented schema (whole conversations, tickets with their outcomes, code with history, documents with structure), typed pseudonyms in place of identifiers, a datasheet, a de-identification report and a rights record. The spec sheets list the fields per data type.

Which file format is best for enterprise conversation data?

JSON Lines with one conversation per line, so a loader never has to stitch messages together. Parquet with the same field layout works for large deliveries. Documents are best as Markdown with a JSONL index.

How can a lab verify de-identification before licensing?

Ask for leak-scan results, a human-reviewed sample with its error rate and recall per language, then run your own review on a random sample: search for contact details, read greetings and signatures, and check token consistency.

What documentation should come with a licensed dataset?

A datasheet covering composition, provenance, processing, de-identification, permitted use and AI Act inputs, plus file checksums, a code book for labels, and the rights record. The datasheet template on this site covers all of it.

What does the EU AI Act require from training data suppliers?

The obligations sit with the model provider, but several answers in its documentation and public summary need supplier facts: token counts, source category, nature of the content, languages and screening measures. Collect them in the contract.

Should a lab license enterprise data exclusively?

Only when exclusivity is worth its cost. Non-exclusive licences are the norm. An exclusive window makes sense for evaluation sets you need to keep uncontaminated, or for a capability you want to ship first.

Can enterprise data be used to build RL environments?

Yes, when tasks have recorded outcomes that a grader can check. Support tickets with resolution codes and code changes with passing tests are the usual starting points.

How do I request a dataset, and what does it cost to ask?

Use the request form or email hello@aidataset.broker. Asking costs nothing and commits you to nothing. Datasets are assembled to spec, de-identified, documented and delivered under a licence with a datasheet.

Long answers

Where each topic is covered in full

Keep reading

Next step

Have a spec? Send it over

Name the data type, languages, period, volume and intended use. We answer by email with what can be assembled and how it would be documented.