Service description:
Data Engineer with a focus on DevOps/MLOps for a forecasting project
Deployment of Kubeflow Pipelines
GitHub Workflows
AWS provisioning with Terraform
Data connection and transformations in Databricks
MUST Requirement:
Python and typical ecosystem (Poetry, Pytest, VSCode etc.)
GitLab (CI yamls , runners, etc.)
Git
Kubeflow
Python SDK
Kubernetes and typical tooling (kubectl, k9s etc.)
Docker
Databricks
AWS:
o S3, Lambda
o Network Config, Gateways, IAM etc.
o AWS CLI and its config, boto3 Python lib
o web console
Service description:
Data Engineer with a focus on DevOps/MLOps for a forecasting project
Deployment of Kubeflow Pipelines
GitHub Workflows
AWS provisioning with Terraform
Data connection and transformations in Databricks
MUST Requirement:
Python and typical ecosystem (Poetry, Pytest, VSCode etc.)
GitLab (CI yamls , runners, etc.)
Git
Kubeflow
Python SDK
Kubernetes and typical tooling (kubectl, k9s etc.)
Docker
Databricks
AWS:
o S3, Lambda
o Network Config, Gateways, IAM etc.
o AWS CLI and its config, boto3 Python lib
o web console