Responsibilities:

<ul>
<li>Data Pipeline/ETL (40%): Designs and implements data stores and ETL data flows and data pipelines to connect and prepare operational systems data for analytics and business intelligence (BI) systems.</li>
</ul>

<ul>
<li>Support &amp; Operations (10%): Manages production deployments and automation, monitoring, job control and production support. Works with business users to test programs in Development and Quality. Investigates issues using vendor support website(s).</li>
</ul>

<ul>
<li>Data Modeling/Designing Datasets (10%): Reviews and understands business requirements for development tasks assigned and applies standard data modelling and design techniques based upon a detailed understanding of requirements.</li>
</ul>

<ul>
<li>Data Architecture and Technical Infrastructure (10%): Plans and drives the development of data engineering solutions ensuring that solutions balance functional and non-functional requirements. Monitors application of data standards and architectures including security and compliance.</li>
</ul>

<ul>
<li>SDLC Methodology &amp; Project Management (5%): Contributes to technical transitions between development, testing, and production phases of solutions' lifecycle, and the facilitation of the change control, problem management, and communication processes.</li>
</ul>

<ul>
<li>Data Governance and Data Quality (5%): Identifies and investigates data quality/integrity problems, determine impact and provide solutions to problems.</li>
</ul>

<ul>
<li>Metadata Management &amp; Documentation (5%): Documents all processes and mappings related to Data Pipelines work and follows development best practices as adopted by the BIA team</li>
</ul>

<ul>
<li>End-User Support, Education and Enablement (5%): Contributes to training and Data Literacy initiatives within the team and End user community.</li>
</ul>

<ul>
<li>Innovation, Continuous Improvement &amp; Optimization (5%): Continuously improves and optimizes existing Data Engineering assets/processes.</li>
</ul>

<ul>
<li>Partnership and Community Building (5%): Collaborates with other IT teams, Business Community, data scientists and other architects to meet business requirements. Interact with DBAs on data designs optimal for data engineering solutions performance.</li>
</ul>

Required Skills:

<ul>
<li>Minimum of 4+ years of experience as Data Engineer</li>
</ul>

<ul>
<li>Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas</li>
</ul>

<ul>
<li>Developing complex SQL queries and SQL optimization</li>
</ul>

<ul>
<li>Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.</li>
</ul>

<ul>
<li>Understanding of Data Architecture</li>
</ul>

<ul>
<li>Knowledge of ETL and data engineering standards and best practices for the design and development of data pipelines and data extract, transform and load processes</li>
</ul>

<ul>
<li>Design, build and test data products based on feeds from multiple systems, using a range of different storage technologies, access methods or both</li>
</ul>

<ul>
<li>Knowledge of data warehousing concepts, including multi-dimensional models and ETL logic for maintaining star-schemas</li>
</ul>

<ul>
<li>Good Understanding of concepts and principles of data modelling. </li>
</ul>

<ul>
<li>Ability to produce, maintain and update relevant data models for specific needs.</li>
</ul>

<ul>
<li>Can reverse-engineer data models from a live system</li>
</ul>

<ul>
<li>SQL programming desirable (i.e., stored procedures dev.)</li>
</ul>

<ul>
<li>Proficient in data analysis, defect identifications and resolutions.</li>
</ul>

<ul>
<li>Strong professional verbal and written communication skills.</li>
</ul>

<ul>
<li>Ability to work with little supervision and within changing priorities.</li>
</ul>

<ul>
<li>Ability to analyze requirements and troubleshoot problems.</li>
</ul>

Data Engineer

Responsibilities: Data Pipeline/ETL (40%): Designs and implements data stores and ETL data flows and data pipelines to connect and prepare operational systems data for analytics and business intelligence (BI) systems. Support &amp; Operations (10%): Manages production deployments and automation, monitoring, job control and production support. Works with business users to test programs in Development and Quality. Investigates issues using vendor support website(s). Data Modeling/Designing Datasets (10%): Reviews and understands business requirements for development tasks assigned and applies standard data modelling and design techniques based upon a detailed understanding of requirements. Data Architecture and Technical Infrastructure (10%): Plans and drives the development of data engineering solutions ensuring that solutions balance functional and non-functional requirements. Monitors application of data standards and architectures including security and compliance. SDLC Methodology &amp; Project Management (5%): Contributes to technical transitions between development, testing, and production phases of solutions' lifecycle, and the facilitation of the change control, problem management, and communication processes. Data Governance and Data Quality (5%): Identifies and investigates data quality/integrity problems, determine impact and provide solutions to problems. Metadata Management &amp; Documentation (5%): Documents all processes and mappings related to Data Pipelines work and follows development best practices as adopted by the BIA team End-User Support, Education and Enablement (5%): Contributes to training and Data Literacy initiatives within the team and End user community. Innovation, Continuous Improvement &amp; Optimization (5%): Continuously improves and optimizes existing Data Engineering assets/processes. Partnership and Community Building (5%): Collaborates with other IT teams, Business Community, data scientists and other architects to meet business requirements. Interact with DBAs on data designs optimal for data engineering solutions performance. Required Skills: Minimum of 4+ years of experience as Data Engineer Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas Developing complex SQL queries and SQL optimization Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture. Understanding of Data Architecture Knowledge of ETL and data engineering standards and best practices for the design and development of data pipelines and data extract, transform and load processes Design, build and test data products based on feeds from multiple systems, using a range of different storage technologies, access methods or both Knowledge of data warehousing concepts, including multi-dimensional models and ETL logic for maintaining star-schemas Good Understanding of concepts and principles of data modelling. Ability to produce, maintain and update relevant data models for specific needs. Can reverse-engineer data models from a live system SQL programming desirable (i.e., stored procedures dev.) Proficient in data analysis, defect identifications and resolutions. Strong professional verbal and written communication skills. Ability to work with little supervision and within changing priorities. Ability to analyze requirements and troubleshoot problems.

Data Engineer · Chennai

Job highlights

Skillset required

Job Description

Job Description for Data Engineer

More at SUTHERLAND