Job Description:

Job Description:

A Senior Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure for storing, processing, and analyzing large sets of data. They work closely with data scientists, analysts, and other stakeholders to ensure data integrity and accuracy.

Responsibilities:

• Design and implement scalable data pipelines for processing and analyzing large volumes of data
• Develop and maintain data storage and retrieval systems
• Collaborate with data scientists and analysts to understand data requirements and design appropriate solutions
• Optimize data processing and storage systems for performance and efficiency
• Ensure data quality and integrity through data validation and testing
• Stay up-to-date with the latest technologies and trends in data engineering

Skill Sets:

• Strong programming skills in languages such as Python, Java, or Scala
• Experience with big data technologies like Hadoop, Spark, and Kafka
• Proficiency in SQL and database management systems
• Knowledge of data modeling and ETL processes
• Excellent problem-solving and analytical skills
• Ability to work independently and collaborate with cross-functional teams
• Strong communication and interpersonal skills

Industry:

Professional Services

Category:

Consultancy

Skills: