Job Overview

Location
Lahore, Punjab
Job Type
Full Time
Date Posted
1 day ago

Additional Details

Job ID
1551
Job Views
40
Work Mode *
On-site
Years of Experience
2 to 4

Job Description

This role focuses on building and optimizing data frameworks using Python and PySpark, handling both structured and unstructured data from diverse sources. The engineer will ensure adherence to software development best practices, optimize data workflows for performance and cost efficiency, and work closely with data teams to maintain high data quality.


Responsibilities

  • Develop scalable data frameworks using Python and PySpark.
  • Handle complex data from multiple sources and ensure efficient processing.
  • Apply software engineering best practices in all development efforts.
  • Optimize ETL pipelines for performance and cost.
  • Collaborate with data teams to uphold data integrity and quality.


Requirements:

  • Strong command of Python, including OOP and design patterns.
  • 2-4 years of relevant experience
  • Expertise in Apache Spark (PySpark) and SQL.
  • Experience in ETL, data modeling, and data warehousing.
  • Proficient in software engineering principles and version control.

Location

Similar Jobs

Dice Tech Recruitment Services

Machine Learning Engineer (L4)

Full Time

Dice Tech Recruitment Services

Senior Data Engineer

Full Time

Dice Tech Recruitment Services

AWS Database Engineer

Full Time

Dice Tech Recruitment Services

Senior Machine Learning Engineer

Full Time