Required

• Bachelors degree in Computer Science, Data Science, Engineering, or related field

• 5+ years of IT and business/industry experience

• 5+ years of hands-on Python development experience

• Proven hands-on Databricks experience

• Experience designing and implementing ETL/ELT pipelines

• Experience in Apache Spark, Python (PySpark), and SQL for data manipulation.

• Proven experience building large-scale distributed applications using SQL, DynamoDB, NoSQL, and design patterns

• Previous experience as a Data Engineer or in a similar role

• Strong understanding of data models, data mining, and segmentation techniques

• Proficiency with AWS Cloud services (EC2, S3, RDS, VPC, CloudTrail, CloudFront, Lambda, EKS, ECS)

• Working knowledge of Linux environments

• Advanced knowledge of software development lifecycle, quality assurance, and project management

• Expertise in Object-Oriented design and application development

• Ability to collaborate across data teams to validate insights and refine data solutions

• Strong analytical and problem-solving skills

• Successful completion of interview required to meet job qualification.

• Team-oriented mindset with ability to work independently

Preferred

• Airline industry experience

• Experience designing and developing ML/AI models

• Proficiency with scientific computing frameworks

Key Responsibilities

• Development &amp; Engineering: Design, develop, document, test, and debug data applications and pipelines with a focus on cloud-native solutions

• System Optimization: Support and troubleshoot software systems, optimize performance, resolve issues, and provide comprehensive follow-up documentation

• Integration &amp; Architecture: Ensure proper system integration and consistency with enterprise standards throughout the application lifecycle

• Collaboration: Partner with business, support, and development teams to recommend and implement system enhancements

Data Engineer

India

Required • Bachelors degree in Computer Science, Data Science, Engineering, or related field • 5+ years of IT and business/industry experience • 5+ years of hands-on Python development experience • Proven hands-on Databricks experience • Experience designing and implementing ETL/ELT pipelines • Experience in Apache Spark, Python (PySpark), and SQL for data manipulation. • Proven experience building large-scale distributed applications using SQL, DynamoDB, NoSQL, and design patterns • Previous experience as a Data Engineer or in a similar role • Strong understanding of data models, data mining, and segmentation techniques • Proficiency with AWS Cloud services (EC2, S3, RDS, VPC, CloudTrail, CloudFront, Lambda, EKS, ECS) • Working knowledge of Linux environments • Advanced knowledge of software development lifecycle, quality assurance, and project management • Expertise in Object-Oriented design and application development • Ability to collaborate across data teams to validate insights and refine data solutions • Strong analytical and problem-solving skills • Successful completion of interview required to meet job qualification. • Team-oriented mindset with ability to work independently Preferred • Airline industry experience • Experience designing and developing ML/AI models • Proficiency with scientific computing frameworks Key Responsibilities • Development &amp; Engineering: Design, develop, document, test, and debug data applications and pipelines with a focus on cloud-native solutions • System Optimization: Support and troubleshoot software systems, optimize performance, resolve issues, and provide comprehensive follow-up documentation • Integration &amp; Architecture: Ensure proper system integration and consistency with enterprise standards throughout the application lifecycle • Collaboration: Partner with business, support, and development teams to recommend and implement system enhancements

Data Engineer · Gurugram

Job highlights

Skillset required

Job Description

Job Description for Data Engineer

More at IGTSolutions