Sr Azure Data Engineer Job at Zapcom, Dallas, TX

VVVzU2dCLy9vRkpPZU94cDJEbVA3MWdWSmc9PQ==
  • Zapcom
  • Dallas, TX

Job Description

  • Design and implement data ingestion, transformation, and movement using Azure Data Factory (ADF), Azure Synapse, and Data Lake.
  • Collaborate with business stakeholders, data scientists, and engineers to build robust data solutions.
  • Develop and manage high-volume, real-time, and batch data ingestion pipelines using Azure Data Factory (ADF).
  • Implement event-driven architectures for real-time data movement and processing.
  • Develop large-scale data processing solutions using Azure Databricks and Apache Spark with PySpark, Scala, or Python.
  • Optimize data partitioning, caching, and indexing for efficient performance.
  • Manage complex transformations and aggregations for structured and unstructured datasets.
  • Design and implement high-performance data models in Azure Synapse Analytics using dedicated SQL Pools and Spark Pools.
  • Optimize query performance, workload management, and cost efficiency in Synapse Analytics.
  • Implement column store indexes, partitioning strategies, and data caching to enhance performance.
  • Design and manage secure, scalable data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2).
  • Implement RBAC (Role-Based Access Control), encryption, and data masking to ensure security.
  • Implement Azure Monitor, Log Analytics, and Application Insights for data pipeline monitoring and troubleshooting.
  • Optimize cost management, auto-scaling, and performance tuning across Azure services.

Requirements

  • 8+ years of experience in data engineering, ETL development, and cloud-based data integration,
  • Strong experience with Azure Data Factory (ADF): ETL/ELT pipeline orchestration and data movement.
  • Azure Databricks: Large-scale data transformation and big data processing with Apache Spark, PySpark, Scala, or Python.
  • Azure Synapse Analytics: Data warehousing, SQL Pools, Spark Pools, and performance tuning.
  • Azure Data Lake Storage Gen2 (ADLS Gen2): Secure, scalable data lake architecture.
  • SQL Server: Advanced T-SQL, stored procedures, indexing, and query optimization.
  • Power BI, Tableau, or other BI tools for data visualization.
  • Financial/Banking experience.

Job Tags

Full time,

Similar Jobs

Technostrides

Information technology - developer - professional Job at Technostrides

Job Title: Information Technology - Developer-ETL/Datastage Professional Location: Hybrid - Tuesdays, Wednesdays, and Thursdays (Open to McLean or Plano office from Day 1) Duration: 6Months Job Description: Freddie Mac is seeking a motivated Developer...

Amazon

Area Manager Job at Amazon

 ...Description External job description Our WW Operations network delivers millions of packages and smiles to Amazon customers every day. We are looking for motivated, customer-focused individuals who want to join our team as an Area Manager. In this role, you will... 

Murray State University

Maintenance Technician III, HVAC/Mechanical | Murray State University Job at Murray State University

 ...good state of repair, quality of work performed, proper care and maintenance of assigned tools and supplies. Thorough knowledge of safe...  ...one of the following skilled trades: Building Trades, Plumbing, HVAC /Mechanical, Electrical, or Central Plant operations.... 

SeekTeachers

Middle/High School French/Spanish Teacher Job at SeekTeachers

Description French Teacher | Spanish Teacher | Teach Abroad | Teach in JeddahSeekTeachers is in search of well experienced French and Spanish teachers who have prior experience of teaching high/middle students in an international... 

Silverline New York

Entry Level Territory Sales Manager Job at Silverline New York

 ...We are currently seeking an entry-level Territory Sales Manager to assist in managing and growing a designated territory or region. Effective...  ..., and recommend changes or improvements. Do you qualify? Bachelor's degree is preferred but not mandatory Demonstrated...