Pyspark Engineer Job at Trinity Technology Solutions LLC, Charlotte, NC

VXJVZUcyYllhckVrRWRzTDJHNStnSjNnTXc9PQ==
  • Trinity Technology Solutions LLC
  • Charlotte, NC

Job Description

Job Description:

Our client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

📌 Note: Only candidates eligible to work on a W2 basis will be considered.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
  • Optimize and troubleshoot complex ETL workflows and data transformation processes.
  • Write efficient SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, and compliance with enterprise standards.
  • Participate in code reviews, testing, and deployment activities.
  • Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering or software development.
  • Strong proficiency in PySpark, Python, and Spark SQL.
  • Solid experience with SQL and relational database systems.
  • Proven expertise in ETL development and data pipeline orchestration.
  • Familiarity with job scheduling tools; Autosys experience is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Experience working in the financial services industry.
  • Familiarity with cloud platforms and big data ecosystems.

Job Tags

Similar Jobs

Kinn Studio

Graphic Designer Job at Kinn Studio

 ...sensibility Contribute fresh, innovative ideas while maintaining brand consistency and driving business objectives. Support with image editing and retouching when neededespecially for email, PDP, and campaign needs Collaborate closely with marketing, brand, and e... 

City of Essex Junction

Site Co-Coordinator - Fleming School Job at City of Essex Junction

 ...afterschool program. Together with your co-coordinator, you will provide oversight, plan daily activities, and supervise staff. During the school day, you will serve as a mainstream teaching assistant at the school, four days a week, from 10a.m.-2p.m. Over the summer, you will... 

Smart Family of Cooling Products

Logistics Administrative Assistant Job at Smart Family of Cooling Products

Job Summary The Logistics Administrative Assistant will play a vital role in supporting our logistics team by managing customer invoices, coordinating logistics, maintaining accurate fleet schedules, and providing exception administrative support. The ideal candidate ...

International Leadership of Texas

4th Grade Spanish ELAR Teacher Job at International Leadership of Texas

 ...to prepare students for exceptional leadership roles in the international community by emphasizing servant leadership, mastering the English...  ...to function successfully in society. Qualifications: Education/Certification: Bachelors degree from accredited... 

Siemens Energy

Technical Training Specialist Power Generation Job at Siemens Energy

A Snap Shot of your Day: The Siemens Energy Global Service Operations Technical Trainer will have the opportunity to work with field engineers and technicians from around the world to give them the knowledge and know-how to maintain and repair Siemens Energy power generation...