dagshub-docs/docs/use_cases/data_engine/index.md

title	description
DagsHub Data Engine - Creating Datasets	Documentation on using Data Engine to create datasets for training

Creating Training Ready Datasets

Data Engine allows you to focus on what’s important - improving your models - by providing a seamless and intuitive flow that includes querying, visualizing, annotating relevant data points, and generating training-ready datasets to re-train your model.

The following use cases will guide you on how to use the Data Engine end to end; from connecting and enriching your data to querying and visualizing, annotating and finally training and improving your model.

Before using DagsHub Data Engine, make sure you have the DagsHub Client installed:

pip install dagshub

next, make sure to import the Datasource class:

from dagshub.data_engine import datasources

Start using Data Engine by connecting your datasource

Connect Datasource

Connect the data you want to work with

Enrich Data

Add custom metadata, predictions and labels to your data

Query Data

Query your data and generate new subsets to re-train your model

Visualize your data

Visualize data points and their enrichments

Annotate your data

Annotate relevant data points

Train a model

Train and improve your model with new datasets