11,319 Azure Data Engineer jobs in the United States

CapB is a global leader on IT Solutions and Managed Services. Our R&D is focused on providing cutting edge products and solutions across Digital Transformations from Cloud, AI/ML, IOT, Blockchain to MDM/PIM, Supply chain, ERP, CRM, HRMS and Integration solutions. For our growing needs we need consultants who can work with us on salaried or contract basis. We provide industry standard benefits, and an environment for LEARNING & Growth.

For one of our going on project we are looking for an AZURE DATA ENGINEER. The position is based out of Des Moines, IA . Locals preferred but can be done remotely for the time being this year.

Responsibilities:
• Create functional design specifications, Azure reference architectures, and assist with other project deliverables as needed.
• Design and Develop Platform as a Service (PaaS) Solutions using different Azure Services
• Create a data factory, orchestrate data processing activities in a data-driven workflow, monitor and manage the data factory, move, transform and analyze data
• Design complex enterprise Data solutions that utilize Azure Data Factory Create migration plans to move legacy SSIS packages into Azure Data Factory
• Build conceptual and logical data models
• Design and implement big data real-time and batch processing solutions
• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
• Develop and document mechanisms for deployment, monitoring and maintenance

Skills and Experience:
• Bachelor's degree or higher in Computer Science Engineering/ Information Technology, Information Systems
• 3+ years experience with Microsoft Cloud Data Platform: Azure Data Factory, Azure Databricks, Python, Scala, Spark SQL, SQL Data Warehouse
• 3+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, data lake solutions
• Expertise with SQL, database design/structures, ETL/ELT design patterns, and DataMart structures (star, snowflake schemas, etc.)
• Functional knowledge of programming scripting and data science languages such as JavaScript, PowerShell, Python, Bash, SQL, .NET, Java, PHP, Ruby, PERL, C++, R, etc.
• Creation of descriptive, predictive and prescriptive analytics solutions using Azure Stream Analytics, Azure Analysis Services, Data Lake Analytics, HDInsight, HDP, Spark, Databricks, MapReduce, Pig, Hive, Tez, SSAS, Watson Analytics, SPSSA
• Experience in Azure Data Factory (ADF) creating multiple pipelines and activities using Azure for full and incremental data loads into Azure Data Lake Store and Azure SQL DW
• Experience for Azure Data Lake Storage and working with Parquet files and partitions
• Experience managing Microsoft Azure environments with VM’s, VNETS, Subnets, NSG’s, Resource Groups, etc.
• Experience in Creation & Configuration of Azure Resources & RBAC
• Experience with Git/Azure DevOps
• Azure certification would be desired
• Must have an ability to communicate clearly and be a team player

zure Data Engineer (Hybrid)
Databricks Certified Data Engineer Associate is required.

Job Location - 4 Irving Place, New York, New York, United States of America, 10003
Azure Data Engineer

Job Description -
1.Azure Platform Experience:
The candidate should have hands-on experience with various Azure services including but not limited to
Azure Data Factory, Databricks, Data Lake, and Power BI.
They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports and visualizations.
Experience with Azure SQL Database, Azure Synapse Analytics, Azure COSMOS DB , Azure ML, other Azure services is a plus.
SQL skill is a must to have And .NET C# skills will be a great plus.

2.Azure Data Engineer: Design, implement, and maintain data solutions using Azure cloud services. Develop ETL processes, optimize data pipelines, and ensure data quality and security. Collaborate with teams to deliver scalable data architecture supporting analytics and business intelligence.

3.Security on Azure Platform:
The candidate should have a strong understanding of security protocols within the Azure platform.
This includes knowledge of identity and access management, network security, encryption methods, secure data communication, and securing serverless architectures.

4.Data Governance:
The candidate should have experience in implementing data governance strategies.
This includes setting up data governance frameworks, defining data ownership, ensuring data quality, and implementing data privacy and compliance measures.
Knowledge of data cataloging, data lineage, and metadata management is also important.

5.Certifications: Azure certifications such as Azure Security Engineer Associate, or Azure Solutions Architect Expert are highly desirable.
Databricks Certified Data Engineer Associate is required.
Databricks Machine Learning Certificate Preferable.

Job Title: Azure data engineer

Duration: 12 months

Location: Atlanta GA ( Remote)

we are looking for locals to Atlanta(availability on PST time zone)

Job Description:

• Looking for Junior Azure data engineer 4-5 years' experience
• To research, evaluate, design, implement, and maintain system and product solutions, applying knowledge of engineering principles.
• Provide technical direction and engineering support for projects and infrastructure.
• Develop and maintain expert functional knowledge of evolving IT engineering industry technologies/competition, concepts and trends.

Location: Camden,New Jersey
Expected Start Date: Jul 7, 2025

Swoon is actively seeking an Azure Middleware Engineer to join the team in Camden, NJ. - Relocation is available!

US Citizen or Permanent Resident/Green Card Holder are required - (Sponsorship and C2C is NOT available at this time or in the future)

What your day-to-day look like?

• Design, develop, and deploy cloud based solutions using Microsoft Azures suite of service
• Create scalable, secure, and efficient applications
• Design, develop, and maintain middleware including Azure Logic Apps, Azure API management, Azure Functions, and Event Grid
• Implement APIs and integration workflows
• Work with service bus, event hubs, and azure data factory for robust integrations

• Established company offering stability and job security
• Collaborative and team-oriented culture
• Competitive benefits including healthcare, retirement savings plans, and bonuses
• Commitment to sustainability including zero-landfill manufacturing plants and partnerships with conservation groups

• 4+ years of experience in Middleware specifically in Azure applications including Logic Apps, API Management, Azure Functions, Service Bus, and Event Grid
• Proficient in Java, Python, JavaScript, .NET, or C#
• Experience with DevOps tools including Azure DevOps, Jenkins, Git, and CI/CD Pipelines
• Strong understanding of REST APIs, SOAP, and other messaging protocols

• Designs, develops, and maintains scalable, efficient data pipelines using Data Factory, and Databricks, leveraging Py Spark for complex data transformations and large-scale processing.
• Builds and manages extract, transform, and load (ETL)/extract, load, transform (ELT) processes to seamlessly extract, transform, and load data from on-premises Oracle systems, customer relationship management (CRM) technology, and connected vehicles into data storage solutions, such as Azure Data Lake Storage and Azure SQL Database.

• Creates high-code data engineering solutions using Databricks to clean, transform, and prepare data for in-depth analysis.
• Develops and manages data models, schemas, and data warehouses, utilizing Lakehouse Architecture to enhance advanced analytics and business intelligence.
• Leverages Unity Catalog to ensure unified data governance and management across the enterprise's data assets.
• Optimizes data storage, retrieval strategies, and query performance to drive scalability and efficiency in all data operations.

• Integrate and harmonize data from diverse sources including on-premises databases, cloud services, APIs, and connected vehicle telematics.
• Ensure consistent data quality, accuracy, and reliability across all integrated data sources.

• Utilizes GitHub for version control and collaborative development, implementing best practices for code management, testing, and deployment.
• Develops workflows for continuous integration (CI) and continuous deployment (CD), ensuring efficient delivery and maintenance of data solutions.

• Work closely with Data Science, Enterprise Data Warehouse, and Data Visualization teams, as well as business stakeholders, to understand data requirements and deliver innovative solutions.
• Collaborate with cross-functional teams to troubleshoot and resolve data infrastructure issues, identifying and addressing performance bottlenecks.
• Provide technical leadership, mentorship, and guidance to junior data engineers, promoting a culture of continuous improvement and innovation.

• Technical Expertise: Extensive experience with Azure Data Factory, Databricks, and Azure Synapse, as well as proficiency in Python and PySpark.
• Data Integration: Experience integrating data from on-premises Oracle systems and connected vehicle data into cloud-based solutions.
• Lakehouse Architecture & Governance: Deep knowledge of Lakehouse Architecture and Unity Catalog for enterprise data governance.
• Version Control & Collaboration: Demonstrated proficiency in GitHub for development, collaboration, and deployment in large-scale environments.
• Infrastructure as Code (IaC): Experience with Infrastructure as Code tools such as Resource Manager (ARM) templates or terraform.
• Problem-Solving & Troubleshooting: Strong analytical skills with the ability to diagnose and resolve complex data infrastructure challenges.
• Collaboration: Proven ability to work effectively with Data Science teams, business stakeholders, and cross-functional teams to drive data-driven insights.
• Communication: Excellent verbal and written communication skills with the ability to translate technical concepts to non-technical stakeholders.

• Hybrid Role: Remote work 2 days per week (After 90 Days Onboarding)
• Travel Required: 0%

• Medical, Dental, Vision Plans
• Pension, Profit Sharing, and 401K Match Offerings
• 15 Vacation days, 9 Company Holidays, 5 Floating Holidays, and 5 Sick days.
• Tuition Reimbursement Program
• Vehicle Discount Programs

senior (1 2 + years ) Azure Data Analyst with extensive experience working with the Azure Data suite listed below. THE CLIENT WOULD LIKE TO SEE CERTIFICATIONS. ***CANDIDATES MUST HAVE RECENT CAPITAL MARKETS/TRADING AND/OR HEDGE FUND EXPERIENCE AND EXCELLENT COMMUNICATION SKILLS. HOT & MOVING FAST!

*** Candidate Must Have's on a resume and for submittal:

1. How many years working with: zure Data Analyst
2. How many years working with: zure Data Factory (ADF
3. How many years working with: Azure Databricks (highlighted expertise)
4. How many years working with: Logic Apps
5. How many years working with: Capital Markets/Hedge Funds

Technical Skills:

• Programming & Tools:
  • 10+ years of experience in SQL , Python . .Net is a plus.
  • 5+ years of experience in Azure cloud services , including:
    • Azure SQL Server
    • Azure Data Factory (ADF)
    • Azure Databricks (highlighted expertise)
    • Azure Data Lake Storage (ADLS)
    • Azure Key Vault
    • Azure Functions
    • Logic Apps
  • 5+ years of experience in GIT and deploying code using CI/CD pipelines .
• Certifications (Preferred):
  • Microsoft Certified: Azure Data Engineer Associate
  • Databricks Certified Data Engineer Associate or Professional

1. Data Pipeline Development:
   • Create and manage scalable data pipelines to collect, process, and store large volumes of data from various sources.
2. Data Integration:
   • Integrate data from multiple sources, ensuring consistency, quality, and reliability.
3. Database Management:
   • Design, implement, and optimize database schemas and structures to support data storage and retrieval.
4. ETL Processes:
   • Develop and maintain ETL (Extract, Transform, Load) processes to ensure accurate and efficient data movement between systems.
5. Data Warehousing:
   • Build and maintain data warehouses to support business intelligence and analytics needs.
6. Performance Optimization:
   • Optimize data processing and storage performance for efficient resource utilization and quick data retrieval.
7. Documentation:
   • Create and maintain comprehensive documentation for data pipelines, ETL processes, and database schemas.
8. Monitoring and Troubleshooting:
   • Monitor data pipelines and systems for performance and reliability, troubleshooting and resolving issues as they arise.
9. Technology Evaluation:

• 401(k)
• 401(k) matching
• Bonus based on performance

• Azure Data Lake Gen1/Gen2
• Azure Data Factory
• Azure Databricks
• Azure Data Warehouse (DWH)
• Azure Synapse Analytics
• Azure Key Vault
• Azure Active Directory
• Python, Scala, SQL
• Blob storage, Event Grid, ESB
• Azure SQL Server, Cosmos DB
• Azure Functions
• Power BI (mandatory)