Responsibilities

Pipeline Building:

<ul>
<li>Develop SQL based data processing pipelines which includes, but not limited, SQL functions, tables, and views</li>
</ul>

Data Validation:

<ul>
<li>Create data validation rules on source data to confirm the data has correct and/or expected values. </li>
</ul>

<ul>
<li>Perform data profiling of source data (SAP datasets) to identify data quality issues and anomalies, business knowledge embedded in data, gathering of natural keys, and metadata information.</li>
</ul>

Data Validation Calls:

<ul>
<li>Interact with client stakeholders and inform about the mismatches observed during validation</li>
</ul>

Qualifications we seek in you!

Minimum Qualifications

<ul>
<li>Strong SQL skills for data manipulation and query optimization</li>
</ul>

<ul>
<li>Experience in basic python and PySpark Coding</li>
</ul>

<ul>
<li>Good experience with version control – git system</li>
</ul>

<ul>
<li>Knowledge of Azure Devops fundamentals</li>
</ul>

<ul>
<li>Hands on experience on unified data analytics platform with Azure Databricks</li>
</ul>

<ul>
<li>Experience of Data Build Tool (dbt) or Databricks Delta Live Table is a huge plus</li>
</ul>

<ul>
<li>Knowledge of Visual Studio Code development is a plus</li>
</ul>

<ul>
<li>Experience in data modelling, data integration and data quality</li>
</ul>

<ul>
<li>Knowledge of data warehouse architectures, design patterns, and performance tuning techniques is a plus</li>
</ul>

<ul>
<li>Customer/Stakeholder Focus</li>
</ul>

<ul>
<li>Functional/Technical skills</li>
</ul>

<ul>
<li>Written/Oral Communication</li>
</ul>

<ul>
<li>Ability to adapt to different priorities and assignments quickly</li>
</ul>

<ul>
<li>Team player with strong communication skills</li>
</ul>

<ul>
<li>Excellent analytical and problem-solving skills</li>
</ul>

Preferred Qualifications/ Skills

<ul>
<li>Bachelor’s degree in computer science or related field</li>
</ul>

<ul>
<li>Relevant years of relevant professional experience (mainly SQL)</li>
</ul>

<ul>
<li>Relevant years’ experience with python and Pyspark development</li>
</ul>

<ul>
<li>Minimum years of experience in Azure Databricks platform</li>
</ul>

Data Engineer

India

Responsibilities Pipeline Building: Develop SQL based data processing pipelines which includes, but not limited, SQL functions, tables, and views Data Validation: Create data validation rules on source data to confirm the data has correct and/or expected values. Perform data profiling of source data (SAP datasets) to identify data quality issues and anomalies, business knowledge embedded in data, gathering of natural keys, and metadata information. Data Validation Calls: Interact with client stakeholders and inform about the mismatches observed during validation Qualifications we seek in you! Minimum Qualifications Strong SQL skills for data manipulation and query optimization Experience in basic python and PySpark Coding Good experience with version control – git system Knowledge of Azure Devops fundamentals Hands on experience on unified data analytics platform with Azure Databricks Experience of Data Build Tool (dbt) or Databricks Delta Live Table is a huge plus Knowledge of Visual Studio Code development is a plus Experience in data modelling, data integration and data quality Knowledge of data warehouse architectures, design patterns, and performance tuning techniques is a plus Customer/Stakeholder Focus Functional/Technical skills Written/Oral Communication Ability to adapt to different priorities and assignments quickly Team player with strong communication skills Excellent analytical and problem-solving skills Preferred Qualifications/ Skills Bachelor’s degree in computer science or related field Relevant years of relevant professional experience (mainly SQL) Relevant years’ experience with python and Pyspark development Minimum years of experience in Azure Databricks platform

Data Engineer · New Delhi

Job highlights

Skillset required

Job Description

Job Description for Data Engineer

More at GENPACT