Azure Databricks Data Engineer Location Rartian NJ Onsite Role OverviewWe are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practicesThe ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes and working with Delta Lake technologies The candidate must possess excellent Python programming skills a solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teamsKey ResponsibilitiesDesign develop and maintain scalable ETLELT pipelines Notebooks using DatabricksBuild and optimize data processing solutions using PySpark and PythonImplement and manage data governance security and access controls using Unity CatalogWork with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniquesDevelop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practicesPerform performance tuning and optimization of Databricks workloadsCollaborate with architects business analysts and stakeholders to understand data requirements and deliver solutionsSupport production deployments troubleshooting monitoring and performance improvementsFollow coding standards documentation and best practices for software development lifecycle SDLCRequired SkillsDatabricks StrongStrong understanding of Databricks architecture and ecosystemHandson experience with Delta Lake Delta Sharing Unity Catalog Structured Streaming Workflow orchestration Performance tuning and optimization Data governance and access managementExperience with Medallion Architecture Bronze Silver Gold layersProgrammingStrong handson coding experience in PythonExperience with PySpark for largescale data processingGood understanding of SQL and query optimizationDevOps CICDExperience implementing CICD processes for Databricks workloadsFamiliarity with Gitbased source control and branching strategiesExperience with deployment automation tools and DevOps pipelinesData Engineering ConceptsETLELT design patternsData modeling and data warehousing conceptsData quality monitoring and observability frameworksGood to Have SkillsAWS Cloud AWS Glue S3 IAM LambdaAzure Cloud Azure Data Factory ADF Azure Storage Azure Databricks Key VaultSoft SkillsExcellent verbal and written communication skillsStrong problemsolving and analytical abilitiesAbility to work effectively in a large global team environmentStrong stakeholder management and collaboration skillsSelfdriven proactive and able to work independently with minimal supervision"
...application due to a disability, contact this employer to ask for an accommodation or an alternative application process.Part-Time Night Auditor Part Time Noelle, Nashville, TN, US8 days ago Requisition ID: 6925Noelle serves as a gathering place for some of the city'...
...Data Entry Clerk (Work At Home) Part Time This is your chance to start a long-lasting career with endless opportunity. Discover the liberty you've been searching for by taking a moment to finish our online application. Benefits: Excellent weekly pay Safe work...
Online Part-time English Teacher Recruitment 1.Have online teaching experience 2.Be a native English speaker with standard pronunciation and no accent 3.Teaching hours can be adjusted based on the teachers availability, and an immediate start is preferred 4...
...answering service is seeking Remote Answering Service Agents to work from home in the United States. The role involves answering calls,... ...fluent in Spanish, and be able to work flexible hours, including weekends. This is a stable opportunity with a supportive work...
...filing cut-offs are at5:00 pmon: 6/14/2024, 8/2/2024, 10/4/2024, 12/6/2024 (final) Under general supervision the Deputy Probation Officer performs professional work in the investigation of adult offenders or juvenile court referrals; supervises probationers;...