Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
444e0b5ac8
added remote url: dvc_s3
1 month ago
57bebc6261
Initial Commit
4 months ago
504f56fb3a
remove root_dir for prediction: not needed
1 month ago
f2a14ca9e4
rm data from git
1 month ago
src
add7cb7ec1
logging run_name for clarity
1 month ago
5cb6149424
Added DVC DAG
1 month ago
750bb6b341
Beautified UI
1 month ago
fc19fd2fdb
dvc init
1 month ago
9032c837d0
added data
1 month ago
27cd9b6a9c
Initial commit
4 months ago
020cef4235
for better clarity
1 month ago
45aa17d1b7
train route working correctly
1 month ago
e7a4e8e560
script to interact with DAGsHub storage
1 month ago
89e1f2be06
experiment-4
1 month ago
fc19fd2fdb
dvc init
1 month ago
77b99f670c
corrected file name
1 month ago
89e1f2be06
experiment-4
1 month ago
eada3d28f1
remove 'Id' from processed data
1 month ago
29dc489dd9
Completed Data Preprocessing
1 month ago
7926c6e1f7
added dvc_s3
1 month ago
97a18fc576
Updated requirements and Initial Setup
4 months ago
9f9fc67db0
Initial Setup: Script and README
1 month ago
a5ecce3dc3
fix typo
1 month ago
Storage Buckets
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

You have to be logged in to leave a comment. Sign In

RuralCredit

Photo by Tom Chen on Unsplash

What is RuralCredit?

RuralCredit is a financial service provided to individuals and businesses in rural areas. It provides loan that help support agricultural activities, rural development, and livelihoods in rural communities.

RuralCredit plays a crucial role in empowering farmers, small businesses, and rural entrepreneurs by providing them with the necessary funds to invest in their operations, purchase equipment, and improve their productivity. It helps bridge the gap between the financial needs of rural communities and the availability of financial resources.

By facilitating access to credit, rural credit contributes to the overall economic growth and development of rural areas, reduces poverty, and enhances the standard of living for rural populations.


Working Screenshots:

1 2 3


Setting Up the Project:

  1. Clone the repository
  2. Create a virtual environment using setup.sh:
    bash setup.sh 
    
  3. Activate the virtual environment (optional, if not done in step 2)
    source activate ./venv
    

Workflow:

  1. Update config: config/config.yaml
  2. Update raw/processed data schema: raw_schema.yaml/processed_schema.yaml (if needed)
  3. Update model parameters: params.yaml (if needed)
  4. Update the entity: src/RuralCreditPredictor/entity/config_entity.py
  5. Update the configuration manager: src/RuralCreditPredictor/config/configuration.py
  6. Update the components: src/RuralCreditPredictor/components
  7. Update the pipeline: src/RuralCreditPredictor/pipeline
  8. Update entrypoint: main.py
  9. Update application: app.py

MLFlow Setup:

Commands to set up the MLFlow environment:

  1. MLFlow Tracking URI:
    export MLFLOW_TRACKING_URI=https://dagshub.com/heydido/RuralCreditPredictor.mlflow
    
  2. MLFlow Tracking Username:
    export MLFLOW_TRACKING_USERNAME=heydido
    
  3. MLFlow Tracking Password:
     export MLFLOW_TRACKING_PASSWORD=********
    

Get these from the DAGsHub server.


DVC Setup:

Commands to set up the DVC environment:

  1. Initialize DVC:

    dvc init
    
  2. Write the DVC file: dvc.yaml

  3. Run the DVC pipeline:

    dvc repro
    

    Note: "dvc repro" will fail if you haven't exported the MLFlow variables as explained in the MLFlow Setup section.

  4. Track each experiment changes with git:

    git add .
    git commit -m "DVC: <message>"
    git push origin main
    
  5. Add DVC Remote (one-time):

    dvc remote add origin s3://dvc
    dvc remote modify origin endpointurl https://dagshub.com/heydido/RuralCreditPredictor.s3
    
  6. Push the DVC changes:

    dvc push
    

DVC DAG:

1


Complete Data Pipeline:

1

for better clarity, visit the DAGsHub repo: RuralCreditPredictor


Owner: Aashish Jaiswal

This project is created using a public template I created: MLProjectTemplate

Tip!

Press p or to see the previous file or, n or to see the next file

About

RuralCredit: Empowering Tomorrow's Opportunities

Collaborators 1

Comments

Loading...