Data Engineer Job at Qode, Pittsburgh, PA

S1ZNL3NUak10clVEYVhNNzZBNEk4N21jcEE9PQ==
  • Qode
  • Pittsburgh, PA

Job Description

Job Description

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:
  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.
Required Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.
Preferred Qualifications:
  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Similar Jobs

Goddard Riverside Community Center

Residential Aide (Baxter Safe Haven) Job at Goddard Riverside Community Center

 ...Job Details Job Location Baxter Safe Haven - Elmhurst, NY Position Type Full-Time Education Level High School Diploma/ GED Salary Range $31154.00 - $38955.00 Hourly Description Organization Overview: The Goddard Riverside Community... 

Information Management Group

Network Cable Technician with Security Clearance Job at Information Management Group

Network Cable Technician Job LocationsUS-PA-West Mifflin Job ID 2025-5832 # of Openings 1 Category Technical Services & Operations Opportunity Information Management Group, Inc. (IMG) is a trusted leader in delivering innovative IT and cybersecurity solutions... 

Maxion Research

Remote Survey and Product Reviewer Job at Maxion Research

 ...for motivated individuals to participate in paid research studies including focus groups, clinical trials, online surveys, secret shopping, and product reviews. If you enjoy sharing your opinion and making an impact, this opportunity is for you. Why Choose Us? You... 

HouseSitter.com

House Sitter Wanted - I’m Randy, Recently Bought A Home In Atlanta Ga I Need A Cleaner Position. I’m Offering $1,050 Bi Weekly For Cleaning. Job at HouseSitter.com

Hey there, Georgia! I'm Randy, a home owner looking for a responsible individual to take care of my house while I'm away. If you're reliable, attentive and love pets, this could be the perfect gig for you.First and foremost, I need someone to take care of my beloved fur...

Mount Vernon City School District

Music Teacher Job at Mount Vernon City School District

Music teachers in Mount Vernon City School District (MVCSD) work with a diverse range of students to provide a dynamic, intensive, and...  ...talents as music scholars, performers, songwriters, and music industry entrepreneurs.Music teachers in Mount Vernon City School...