Key Responsibilities:

<ul>
<li>Design and implement scalable data processing solutions using Hadoop, Spark (Scala), and Hive.</li>
</ul>

<ul>
<li>Develop and optimize ETL workflows for large datasets.</li>
</ul>

<ul>
<li>Perform data ingestion from various sources and ensure data integrity.</li>
</ul>

<ul>
<li>Collaborate with data engineers, analysts, and business teams to understand requirements.</li>
</ul>

<ul>
<li>Monitor and troubleshoot big data applications for performance and reliability.</li>
</ul>

<ul>
<li>Implement best practices for data security and compliance.</li>
</ul>

Required Skills &amp; Qualifications:

<ul>
<li>Strong experience in Hadoop ecosystem (HDFS, YARN, MapReduce).</li>
</ul>

<ul>
<li>Proficiency in Apache Spark with Scala programming.</li>
</ul>

<ul>
<li>Hands-on experience with Hive and SQL for data querying.</li>
</ul>

<ul>
<li>Knowledge of data modeling and distributed computing concepts.</li>
</ul>

<ul>
<li>Familiarity with performance tuning and optimization in big data environments.</li>
</ul>

<ul>
<li>Experience with version control tools (Git) and workflow schedulers (Oozie, Airflow).</li>
</ul>

<ul>
<li>Bachelor’s degree in Computer Science, Engineering, or related field. </li>
</ul>

Bigdata Developer

India

Key Responsibilities: Design and implement scalable data processing solutions using Hadoop, Spark (Scala), and Hive. Develop and optimize ETL workflows for large datasets. Perform data ingestion from various sources and ensure data integrity. Collaborate with data engineers, analysts, and business teams to understand requirements. Monitor and troubleshoot big data applications for performance and reliability. Implement best practices for data security and compliance. Required Skills &amp; Qualifications: Strong experience in Hadoop ecosystem (HDFS, YARN, MapReduce). Proficiency in Apache Spark with Scala programming. Hands-on experience with Hive and SQL for data querying. Knowledge of data modeling and distributed computing concepts. Familiarity with performance tuning and optimization in big data environments. Experience with version control tools (Git) and workflow schedulers (Oozie, Airflow). Bachelor’s degree in Computer Science, Engineering, or related field.

Bigdata Developer · Egattur

Job highlights

Skillset required

Job Description

Job Description for Bigdata Developer

More at COGNIZANT