Lead Data Engineer

Job Purpose / Objective

Supporting Analytics Data Architecture, Data Governance, Data Quality Assurance, Modeling, Data Landscape documentation and data pipelines for all data objects supporting Operational Reporting and KPI’s.

Main Accountabilities

• Support in the design, implementation and update of NLNG Data architecture, modeling, and process design for raw data objects, intermediary, aggregate tables across a variety of subject matters and data types.
  This includes Big Data ETL and ELT planning and implementation, and coordination with other company business areas or departments.
• Design, construct, and manage the data lake environment including: Data ingestion, staging, data quality monitoring, and business modelling
• Develop, construct, test and maintain architectures (databases and large-scale processing systems)
• Design, develop and implement technical solutions in SQL environment (databases, SQL, data marts, integrations)
• Develop visual reports in Power BI; Maintain and develop queries and stored procedures using T- SQL and Support data integrations
• Maintaining, securing and protecting first party data and supporting end user consumption for key areas.
• Development of internal tools and procedures to make data more accessible.
• In collaboration with the data analytics & reporting team, manage and support Azure Machine Learning environment.

Job Requirements
Education:

• A University Degree in Computer Sciences or Physical Sciences or Engineering; professional qualifications will be an advantage.

Experience:

• 10 to 12 years post-graduation experience, out of which 7 years should be a similar role within the IT department or Digital function or R&D function of a reputable organization preferably Oil & Gas company.

Competency Requirements:

• Highly skilled in SQL programming in T-SQL building stored procedures and jobs
• Strong functional understanding of Azure Machine Learning
• Ability to manage large volume data integration/ETL; experience with SQL Server Integration Services (SSIS) including ability to configure SQL Server agent
• Expertise in identifying and mapping data elements across multiple systems
• Knowledge of Power BI report visualizations, Data Analysis Expressions (DAX), Power Query (M), and Power BI data modeling
• Strong understanding of data integration, quality and validation
• Strong understanding of MDM, Data Warehouse/Data mart and relational database design
• Excellent written and verbal communication skills and able to interact with multiple IT teams and business partners both formally and informally
• Effective time management, ability to multi-task with changing priorities while continuing to provide exceptional client service
• Ability to work in a fast-paced agile environment (tools and processes).

Tagged as: oil & gas