Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Integration:  dvc git github
khuyentran1401 eee819eca1
Commit changes in dvc.lock
1 year ago
aaf8d9fe36
add default remote for dvc
1 year ago
845c088713
change params
1 year ago
fa4897bec5
change the name of github workflow
1 year ago
55a63dbddb
add gh workflow
1 year ago
src
150520d734
edit segment.py
1 year ago
541dc00ac5
edit test
1 year ago
1ba42131cc
add dvc
1 year ago
de52079bda
add processed functions
2 years ago
55a63dbddb
add gh workflow
1 year ago
484f2da37c
add prefect
1 year ago
ff08115759
edit code
1 year ago
55a63dbddb
add gh workflow
1 year ago
a28ead1b57
track metrics.csv with git
2 years ago
67873cc044
Update README.md
1 year ago
eee819eca1
Commit changes in dvc.lock
1 year ago
fa4897bec5
change the name of github workflow
1 year ago
b79a5a3969
process_1
2 years ago
55a63dbddb
add gh workflow
1 year ago
Storage Buckets
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

You have to be logged in to leave a comment. Sign In

View on Medium

Prefect + DVC Demo

A demo on how to use Prefect with DVC

Tools Used in This Project

  • DVC: Data version control
  • Prefect: Orchestrate and observe dataflow

Project Structure

  • src: consists of Python scripts
  • config: consists of configuration files
  • data: consists of data
  • notebook: consists of Jupyter Notebooks
  • tests: consists of test files

Set Up the Project

  • Install requirements:
pip install -r requirements.txt

Run the Project

To run all flows, type:

python src/main.py
Tip!

Press p or to see the previous file or, n or to see the next file

About

No description

Collaborators 1

Comments

Loading...