Azure Data Engineer Job at 2T Consulting, Doraville, GA

  • 2T Consulting
  • Doraville, GA

Job Description

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills
  • Azure Synapse Analytics
  • PySpark
  • Apache Spark architecture
  • Spark SQL
  • Data Lake architecture
  • Medallion Architecture
  • Data transformation and processing
  • Strong troubleshooting and problem-solving skills
Nice-to-Have
  • Microsoft Fabric
  • Experience with modern cloud data platforms
Responsibilities
  • Design, develop, and optimize data solutions using Azure Synapse Analytics.
  • Develop scalable data pipelines and transformations using PySpark and Spark SQL.
  • Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Troubleshoot performance, data quality, and pipeline-related issues.
  • Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
  • Evaluate and leverage Microsoft Fabric capabilities where appropriate.
  • Provide technical leadership and contribute to solution architecture and development standards.
Required Qualifications
  • 8+ years of experience in data engineering, cloud platforms, or related technology roles.
  • Strong hands-on experience with Azure Synapse Analytics.
  • Strong programming experience with PySpark and Spark SQL.
  • Deep understanding of Apache Spark and distributed data processing.
  • Experience designing and implementing Data Lake architectures.
  • Excellent communication and collaboration skills.
  • Strong analytical, troubleshooting, and problem-solving abilities.

Job Tags

Similar Jobs

AEG Presents

Email Marketing Manager Job at AEG Presents

 ...We're looking for an experienced Email Marketing Manager to create and optimize email campaigns that grow engagement, increase sales, and strengthen customer relationships. The ideal candidate is data-driven, highly organized, and excited about bringing marketing campaigns... 

CRH

Ready Mix Truck Driver Job at CRH

 ...The Preferred Source of quality sand, rock, landscape products, ready-mixed concrete, asphalt, paving and construction services. We...  ...feel for our company culture, watch this video: Ready Mix Truck Driver Key Responsibilities (Essential Duties and Functions)... 

Unitek Learning

Test Proctor - Part Time Job at Unitek Learning

 ...Test Proctor - Part Time We are seeking reliable and detail-oriented individuals to join our team as Test Proctors. In this role, you will be responsible for maintaining the integrity and security of academic testing environments. Proctors play a crucial role in upholding... 

Department of Justice

Correctional Officer (Correctional Systems Officer) Job at Department of Justice

 ...Correctional Systems Department Position This position is located in the Correctional Systems Department at a Federal Bureau of Prisons...  ...consisting of Mail Room, Receiving and Discharge, and Records Office. This position involves a wide range of duties that require... 

NWA

Pension Analyst Job at NWA

 ...Pension ProcessorSeattle, WAAre you a detail-oriented professional with excellent communication skills? Join our team as a Pension Processor and play a key role in ensuring participants receive the retirement benefits they deserve.What you'll be doing...As a pension claims...