Loading...
Share this Job

Data Engineering Specialist

Apply now »

Date: 10-Nov-2020

Location: Mumbai, IN

Company: Lloyds Register

Job ID:31783
Location:Mumbai : India Management Office (LR_L000156)
Position Category:Information Technology
Position Type:Employee Regular

 

Role purpose:

 

  • We are seeking an experienced Microsoft Azure Data Engineer with good track record of delivering data engineering projects using the Azure stack. We are building a Data Analytics Platform using Azure technologies – Azure Data Lake, Azure Data Warehouse / Synapse, Power BI etc.  This platform will ingest, transform, prepare and train data from disparate source systems including SAP, Oracle, Salesforce.com etc.
  • We are looking for an individual who is highly skilled in Azure Data Lake, Azure Data Warehouse / Synapse with specific focus on Azure Data Factory and Azure Databricks with a good knowledge of SQL, Apache Spark, Python, Scala.
  • This is a key role that needs someone who is passionate about the value data engineering can deliver. Good people/communication skills will be vital as you will be working in an agile development environment and being able to take the initiative will be essential.

 

Technical / Professional Qualifications / Requirements:

 

  • Strong experience using Azure Data components – Azure Data Lake, Azure Data Warehouse / Synapse.
  • Specific focus Azure Data Factory and Azure Databricks.
  • Good knowledge of Apache Spark, Python, Scala.
  • Strong knowledge of SQL and schema design using structured and semi-structured data.
  • CI/CD, Azure DevOps experience, highly desirable.
  • Experience in Machine Learning and Artificial Intelligence for Predictive Analytics would be an advantage.

 

Key Responsibilities:

 

  • Design and build of pipelines to ingest data from source systems into Azure Data Lake.
  • Design and build of data transformation and loading into Azure Data Warehouse / Synapse.
  • Lead data preparation, data training implementation using best practices.
  • Implement machine learning and AI techniques in data preparation and transformations.
  • Own the code release management process for all environments.
  • Working closely with internal architects and advise on industry best practice.
  • Work with software vendors and suppliers to ensure system reliability.
  • Conduct activities in line with internal procedures, legislation and industry standards.
  • To pursue Continuous Professional Development and maintain a high degree of discipline knowledge and awareness.
  • To mentor/coach other specialist employees to achieve effective specialist knowledge transfer and application.
  • Ensures documentation/data/information and tasks relevant to the section are planned, evaluated and processed in accordance with local business requirements and agreed deadlines.
  • Review & analyse data to provide management information/statistics, including the identification and reporting of process failures, to support the overall delivery of processes.

 

Copyright © Lloyd's Register 2020. All rights reserved. Terms of usePrivacy policy.

The Lloyd's Register Group comprises charities and non-charitable companies, with the latter supporting the charities in their main goal of enhancing the safety of life and property, at sea, on land and in the air - for the benefit of the public and the environment. (Group entities)

Lloyd's Register logo


Job Segment: Database, Engineer, ERP, Oracle, SQL, Technology, Engineering