16,568 Azure Data jobs in the United States

AI Fire is a leading provider of fire and life safety services in the U.S. We offer national account services via our vendor network at Academy Fire and serve local and regional customers through Impact Fire's employed technicians.

Our hybrid model allows us to simultaneously cater to national, multi-site customers who wish to outsource the vendor management process and support customers who prefer a direct relationship with fire protection professionals.

NATURE OF POSITION:

AI Fire is seeking a skilled and driven Azure Data Engineer to design, develop, and maintain scalable data warehouse solutions using the Microsoft Azure ecosystem. You'll play a key role in enabling data-driven decision making by building reliable data pipelines, standardizing data from multiple systems, data management and optimizing cloud data infrastructure.

Position can be remote or located out of one of our offices in Long Beach, CA, Lynbrook, NY, Round Rock, TX, Phoenix, AZ, Houston, TX or Charlotte, NC.

JOB RESPONSIBILITIES:

• Design and implement efficient data pipelines using Azure Fabric, Data Factory, Databricks, and Synapse Analytics
• Develop ETL/ELT processes to ingest, transform, and load large volumes of data
• Create and maintain data models, lakehouse architecture, and data warehousing solutions
• Collaborate with business analysts and business stakeholders to understand data requirements
• Monitor and optimize data workflows for performance and cost
• Ensure data quality, security, and compliance with governance standards
• Automate data validation and testing procedures
• Building dashboards as needed in PowerBi

• Strong proficiency in Azure data services: Fabric, Data Factory, Databricks, Synapse, Logic Apps, Azure SQL, etc.
• Experience with Python, SQL, Spark, or Scala
• Experience with Workflow Definition Language (WDL)
• Solid understanding of cloud architecture and data lake principles
• Familiarity with CI/CD tools and DevOps practices in Azure
• Working knowledge of data governance, privacy, and security practices
• Certifications: Microsoft Certified Azure Data Engineer Associate
• Understanding of general data in ERP systems
• Experience with Power BI integration
• Knowledge of machine learning workflows and integration
• Analytical mindset and problem-solving attitude
• Strong communication and teamwork abilities
• Adaptability in a fast-paced, agile environment
• Experience in other platforms such as AWS data fabric (Redshift, Glue, Athena) or Databricks will also be considered
• Bachelor's degree in Computer Science, Engineering, or related field

Well versed with Hadoop, Spark, Cloud, PythonScala and Java, Streaming, Kafka, Backend, J2EE.
You evangelize an extremely high standard of code quality, system reliability, and performance
You have a proven track record coding with at least one programming language (e.g., Scala, Python)
Youre experienced in one of cloud computing platforms (e.g., GCP, Azure)
Youre skilled in data modeling data migration protocols
Experience with GCP, Data warehousing, BI preferred
Experience with the integration tools like Automic, Airflow

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Key Responsibilities:
• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks.
• Ingest, transform, and curate structured and unstructured data from diverse sources for AI/ML consumption.
• Optimize data workflows for performance, reliability, and cost-efficiency.
• Enable data access and preparation for Azure AI services, including Azure Machine Learning, Azure OpenAI, and Cognitive Services.
• Collaborate with data scientists and ML engineers to operationalize AI models using MLOps and GenAIOps practices.
• Support RAG (Retrieval-Augmented Generation) and other GenAI patterns through data engineering best practices.
• Implement CI/CD pipelines for data workflows using Azure DevOps or GitHub Actions.
• Automate infrastructure provisioning using Terraform, Bicep, or ARM templates.
• Monitor and troubleshoot data pipelines and cloud resources using Azure Monitor and Log Analytics.

Skills and Qualifications:
• 8- 10+ years of experience in data engineering, cloud platforms, and big data technologies.
• Strong proficiency in Azure services: Data Factory, Synapse, Data Lake, Azure SQL, Cosmos DB.
• Experience with Python, Spark, SQL, and distributed data processing.
• Familiarity with AI/ML workflows and tools such as Azure ML, MLflow, and OpenAI APIs.
• Understanding of data governance, security, and compliance in cloud environments.

Location: NYC, NY (Midtown) hybrid WFH

As a crucial member of our Data and AI team, this role is pivotal in driving our data strategy and achieving our analytical goals. The individual will play an essential part in transforming raw data into actionable insights, thereby empowering the team to make data-driven decisions that enhance our financial services. With a focus on innovation and precision, the role ensures the integrity and availability of data, which is fundamental to our reporting, analytics, and machine learning initiatives. By developing and maintaining robust data pipelines and implementing efficient ETL processes, the role supports the team's mission to deliver unparalleled financial solutions and services to our clients.

• Interact with business stakeholders at all levels to understand data needs.
• Collaborate with in-house resources and consultants acting as data scientists, technical analysts, business report writers, and other SMEs to deliver high-quality data solutions.
• Coordinate and communicate with members of the IT team regularly to ensure smooth IT operations.
• Stay up to date with the latest trends and best practices in data engineering and related technologies.

• Design, develop, deploy, and maintain scalable data pipelines and ETL processes using Microsoft Fabric.
• Ingest data from various sources including, but not limited to, REST APIs, flat files, SQL databases, SharePoint libraries and lists, and Azure storage.
• Optimize data ingestion method for each source considering factors such as data availability from vendor, frequency of data updates, resource usage, cost, etc.
• Implement data integration solutions to consolidate data from various sources into a unified data platform.

• Perform data transformations at all layers of a medallion architecture to support business reporting, analytics, and machine learning needs.
• Create and maintain notebooks, stored procedures, and other data transformation methods, leveraging version control.
• Automate data transformations through scheduling and data pipelines.
• Implement data security using row-level and column-level security, and other available methods.

• Optimize and tune data workflows for performance and reliability.
• Ensure data quality, integrity, and security across all data processes.
• Monitor platform performance and provide utilization analysis and recommendations on required resources.
• Develop and maintain documentation for data engineering processes and solutions.

• 2+ years of experience with Azure Data Engineering.
• Proficiency in Microsoft Fabric and related technologies (e.g., Azure Data Factory, Azure Synapse Analytics, etc.).
• Strong SQL experience.
• Experience with Python programming.
• Experience with Spark.

• T-SQL experience.
• Experience with Data Modeling.
• Experience with Python libraries, specifically Pandas and MLlib.
• Experience with Data Science/Machine Learning.
• Experience with AzureDevOps.
• Scala or other Functional Programming experience.
• Azure certifications.
• Experience working in financial services.
• Bachelor's or Master's Degree in Computer Science or another IT/Data related field.

Job Title: Azure Data Engineer

Location: Spring Texas (On-Site)

Need Only Local to Houston, TX

Experience: 10+ Years

• Perform ETL, ELT operations and administration using modern tools, programming languages and systems securely and in accordance with enterprise data standards.
• Assemble, model, and transform large complex sets of data that meet non-functional and functional business requirements into a format that can be analyzed.
• Automate data processing from multiple data sources.
• Develop, deploy, and version control code for data consumption, reuse for APIs.
• Employ machine learning techniques to create and sustain data structures.
• Perform root cause analysis on external and internal processes and data to identify opportunities for improvement and resolve data quality issues.
• Lead data-related workshops with stakeholders to capture data requirements and acceptance criteria.

We are looking for someone who has technical depth and broad tool experience related to data engineering and has the following required qualifications:

• Minimum bachelors degree in Data Science, Business Intelligence, Statistics, Computer Engineering, or related field, or the equivalent combination of education, professional training, and work experience.
• 5 or more years performing duties related to data engineering.
• Advanced English level.
• Expert proficiency in at least one of these programming languages: Python, NoSQL, SQL, R, and competent in source code management.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Create data validation methods and data analysis tools.

• Excellent problem-solving skills and ability to learn through scattered resources.
• Automate routine tasks via scripts and code.
• Capacity to successfully manage a pipeline of duties with minimal supervision.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Modify existing reports, extracts, dashboards, and cubes as necessary.
• Commitment to operations integrity and ability to hold self and others accountable for results.

• Advanced
• SQL
• Snowflake
• Tamr
• Python
• GitHub
• Intermediate
• Databricks
• Airflow

The Azure Data Engineer is responsible for building, implementing, and supporting Microsoft BI solutions to meet market and/or client requirements.

They apply knowledge of technologies, applications, methodologies, processes, and tools to support a client, project, or entity.

We are currently looking for programmers or experienced programmers with strong technical expertise in the Microsoft BI Stack (T-SQL, SSIS). Additional skills such as SAP BI or Power BI reporting are a plus.

As part of a collaborative team, and under the supervision of a project lead, the candidate will be responsible for designing and developing software products to implement new features and support existing applications.

• Create ER diagrams and write relational database queries
• Create database objects and maintain referential integrity
• Configure, deploy, and maintain databases
• Participate in the development and maintenance of Data Warehouses
• Develop ADF pipelines utilizing various activities for data ingestion and transformation
• Apply knowledge of Python scripting and Spark APIs
• Understand Azure Pass/SAAS and Azure Stream Analytics
• Knowledge of Azure Storage Account
• Design, develop, and deploy SSIS packages
• Create and deploy reports
• Provide technical design and coding support to the team to meet project deliverables
• Communicate with clients to gather business requirements

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Functions
• Azure Blob Storage
• Azure Logic Apps
• C# and .NET, SQL Server
• Azure Synapse
• Azure DevOps
• Azure Storage/Data Lake
• ETL processes
• Analytics development
• Report development
• Relational databases and SQL language

• Design and implement robust data pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
• Develop and maintain scalable ETL processes to support data warehousing and analytics initiatives.
• Utilize SQL, Python, or Scala for data processing, transformation, and analysis.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
• Optimize data workflows for performance, reliability, and scalability in a cloud environment.
• Ensure data quality, integrity, and security across all stages of the data lifecycle.
• Support the development and maintenance of enterprise data warehouses and data lakes.

• 5+ years of experience in data engineering or a related field.
• Strong hands-on experience with Azure Databricks, SQL, and either Python or Scala.
• Deep understanding of data warehousing concepts and ETL processes.
• Experience with Azure services such as Data Factory, Synapse Analytics, and Blob Storage.
• Familiarity with CI/CD practices and version control tools (e.g., Git).
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities.

Job Title: Azure Data Engineer

Location: Cincinnati,OH (Hybrid)

Duration : 6 Months Only (C2H)

Drop Resumes to

Exp :13+

Key Responsibilities

Experience in Data modeling and advanced SQL techniques

Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services

Expert in SQL, Python, Spark, Databricks

Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation

Experience with DevOps process and understanding of Terraform scripting
About Us:
InterSources Inc , a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.