Profile Requirements
The contractor must be a senior Cloud Native Data Engineer, combining a strong technical background in data
engineering with expertise in implementing data architectures, and innovative mindset to contribute effectively.
We are looking for contractors with:
Proven experience in Data Engineering with a focus on designing and implementing scalable data architectures
• Extensive experience with databases, data lakes, and data warehouses and message brokers (eg: Kafka)
• Hands-on experience with ETL processes and data integration from various sources
• Familiarity with modern data technologies and cloud services.
• Proficient in designing and implementing data models to meet business requirements. ∙ Experience with Data Mesh
• A keen interest in staying updated on emerging technologies in the data engineering and Data space.
• Experience with evaluating and recommendation of the adoption of new tools and technologies.
Innovative mindset to propose solutions enhancing the organization’s data architecture
Must-have experience
• A minimum experience of 5 years in Cloud Native Data Engineering.
• Experience with rearchitecting existing monolithic architecture to micro-services based Cloud Native architectures.
• Strong understanding of Cloud Native architectures (loosely coupled services, containers, horizontal scalability,
application resilience patterns).
• Proficiency in at least one programming language – Java or Scala
● Knowledge and experience with at least some of the Data technologies/frameworks:
o Workflow orchestration (AirFlow/Oozie etc.)
o Data integration/Ingestion (Nifi, Flume etc)
o Messaging/Data Streaming (Kafka/RabbitMQ etc.)
o Data Processing (Spark, Flink etc.)
o RDBMS (PostgreSQL/MySql etc.)
o NoSQL Storages (MongoDB, Cassandra, Neo4j etc.)
o Timeseries (InfluxDB, OpenTSDB, TimescaleDB, Prometheus etc.)
• And / Or with their Cloud provided counterparts, i.e., Cloud Data/Analytics services (GCP, Azure, AWS)
Proficiency in the following Tech Stack:
• Deployment & Containerization: Docker, Kubernetes, Helm.
• CI/CD & DevOps Tools: Azure DevOps, Gitlab CI Actions, GitOps, Gitlab, Bash/Shell scripting, Linux
• Database change management: tools (such as Liquibase or Flyway)
• Familiarity with agile development methodologies and tools (e.g., Scrum, SAFE, JIRA, Confluence).