Save Job Back to Search Job Description Summary Similar JobsCompetitive SalaryOpportunity to work on exciting projectsAbout Our ClientA company in the industrial and manufacturing sector.Job DescriptionStrong experience in Microsoft Azure cloud-native development, including Azure Databricks, ADLS, Azure Key Vault, and Microsoft Entra ID (Azure AD) integration.Proficient in data engineering and processing using Python, Spark, SQL, with experience in Databricks workflows, Hive Metastore, and data lake architectures.Knowledge of Databricks advanced features such as cluster management, Unity Catalog, Medallion Architecture, and data processing with Pandas/Polars is an advantage.Skilled in authentication, secrets management, and security, including Azure Key Vault integration with Databricks and Azure DevOps.Proficient in programming and scripting languages, including Python, SQL, KQL, PowerShell, and Bash.Experience with version control, collaboration, and Agile delivery, including GitHub, Azure Repos, pull request workflows, branching strategies, SCRUM, and SAFe.Hands-on experience in CI/CD, automation, monitoring, and logging, leveraging Azure DevOps Pipelines, GitHub Actions, YAML deployments, and Azure Log Analytics.Familiar with API and platform development, including FastAPI, REST APIs, Docker, ACR, Databricks/Azure CLI, and event-driven solutions using NATS and Redis.The Successful ApplicantA successful Data Engineer should have:Proficiency in data engineering tools and technologies.Strong knowledge of database systems and data modelling.Experience in developing and managing data pipelines and ETL processes.Understanding of data security and privacy best practices.Problem-solving skills and a detail-oriented approach to work.Ability to collaborate effectively within a team environment.What's on OfferContract: 1 year (Extendable)Medical BenefitsOpportunity to contribute to meaningful large scale projectsOpportunity to work with cross functional international teamsIf you are ready to take on this temporary role as a Data Engineer, we look forward to receiving your application.ContactCharlene FernandezQuote job refJN-072026-7074871Phone number+60323024024Job summaryFunctionITSpecialisationIT Data AnalysisWhat is your area of specialisation?Industrial / ManufacturingLocationMalaysiaContract TypeTemporaryConsultant nameCharlene FernandezConsultant contact+60323024024Job ReferenceJN-072026-7074871Work from HomeWork from Home or Hybrid