Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

secret.txt 2.9 KB

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
  1. # Kidney-disease-classification
  2. ## Workflows
  3. 1. Update config.yaml
  4. 2. Update secrets.yaml [Optional]
  5. 3. Update params.yaml
  6. 4. Update the entity
  7. 5. Update the configuration manager in src config
  8. 6. Update the components
  9. 7. Update the pipeline
  10. 8. Update the main.py
  11. 9. Update the dvc.yaml
  12. 10. app.py
  13. # How to run?
  14. ### STEPS:
  15. Clone the repository
  16. ```bash
  17. https://github.com/atifabedeen/Kidney-disease-classification
  18. ```
  19. ### STEP 01- Create a conda environment after opening the repository
  20. ```bash
  21. conda create -n venv python=3.8 -y
  22. ```
  23. ```bash
  24. conda activate venv
  25. ```
  26. ### STEP 02- install the requirements
  27. ```bash
  28. pip install -r requirements.txt
  29. ```
  30. ```bash
  31. # Finally run the following command
  32. python app.py
  33. ```
  34. Now,
  35. ```bash
  36. open up you local host and port
  37. ```
  38. ## MLflow
  39. - [Documentation](https://mlflow.org/docs/latest/index.html)
  40. ##### cmd
  41. - mlflow ui
  42. ### dagshub
  43. [dagshub](https://dagshub.com/)
  44. MLFLOW_TRACKING_URI=https://dagshub.com/atifabedeen/Kidney-disease-classification.mlflow\
  45. MLFLOW_TRACKING_USERNAME=atifabedeen \
  46. MLFLOW_TRACKING_PASSWORD=16016383a5473986427fdc2d8b62f8b0d26c3581 \
  47. python script.py
  48. Run this to export as env variables:
  49. ```bash
  50. export MLFLOW_TRACKING_URI=https://dagshub.com/atifabedeen/Kidney-disease-classification.mlflow
  51. export MLFLOW_TRACKING_USERNAME=atifabedeen
  52. export MLFLOW_TRACKING_PASSWORD=16016383a5473986427fdc2d8b62f8b0d26c3581
  53. ```
  54. ### DVC cmd
  55. 1. dvc init
  56. 2. dvc repro
  57. 3. dvc dag
  58. ## About MLflow & DVC
  59. MLflow
  60. - Its Production Grade
  61. - Trace all of your expriements
  62. - Logging & taging your model
  63. DVC
  64. - Its very lite weight for POC only
  65. - lite weight expriements tracker
  66. - It can perform Orchestration (Creating Pipelines)
  67. # AWS-CICD-Deployment-with-Github-Actions
  68. ## 1. Login to AWS console.
  69. ## 2. Create IAM user for deployment
  70. #with specific access
  71. 1. EC2 access : It is virtual machine
  72. 2. ECR: Elastic Container registry to save your docker image in aws
  73. #Description: About the deployment
  74. 1. Build docker image of the source code
  75. 2. Push your docker image to ECR
  76. 3. Launch Your EC2
  77. 4. Pull Your image from ECR in EC2
  78. 5. Lauch your docker image in EC2
  79. #Policy:
  80. 1. AmazonEC2ContainerRegistryFullAccess
  81. 2. AmazonEC2FullAccess
  82. ## 3. Create ECR repo to store/save docker image
  83. - Save the URI: 533267053056.dkr.ecr.us-east-1.amazonaws.com/kidney
  84. ## 4. Create EC2 machine (Ubuntu)
  85. ## 5. Open EC2 and Install docker in EC2 Machine:
  86. #optinal
  87. sudo apt-get update -y
  88. sudo apt-get upgrade
  89. #required
  90. curl -fsSL https://get.docker.com -o get-docker.sh
  91. sudo sh get-docker.sh
  92. sudo usermod -aG docker ubuntu
  93. newgrp docker
  94. # 6. Configure EC2 as self-hosted runner:
  95. setting>actions>runner>new self hosted runner> choose os> then run command one by one
  96. # 7. Setup github secrets:
  97. AWS_ACCESS_KEY_ID=
  98. AWS_SECRET_ACCESS_KEY=
  99. AWS_REGION = us-east-1
  100. AWS_ECR_LOGIN_URI = demo>> 566373416292.dkr.ecr.ap-south-1.amazonaws.com
  101. ECR_REPOSITORY_NAME = simple-app
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...