3,779 Lead Data Engineer jobs in the United States

Lead Data Engineer

53205 Milwaukee, Wisconsin Northwestern Mutual

Posted today

Job Viewed

Tap Again To Close

Job Description

Primary Duties & Responsibilities

  • Apply engineering best practices in order to analyze, design, develop, deploy and support software solutions.

  • Influence team members through lean agile leadership.

  • Mentor on Software Craftsmanship and Quality Standards.

  • Develop software using continuous Deployment and integration practices.

  • Participate in an Agile implementation and maintenance of source control and release procedures.

  • Participate in Code Reviews and feedback to the team.

  • Mentor technical members of the team.

  • Contribute to a collaborative work environment in which all team members are respected regardless of their individual differences and are motivated to improve both their individual and team contributions.

  • Identify data quality issues and their root causes.

  • Propose fixes and design data audits.


Qualifications

  • Bachelor's Degree.

  • 6-8 years of professional experience.

  • At least 6 years of professional data engineering, software engineering, debugging, analysis, testing and software documentation experience.

  • Advanced programming skills.

  • Code Knowledge: Python, SQL, HCL (Terraform), Apache Spark.

  • Experience with Agile methodologies/DevOps environment.

  • Experience with AWS environment (Redshift, AWS Glue).

  • Strong understanding of database structures, theories, principles, and practices.

  • Strong understanding of Data Quality and Data Concepts.

  • Strong understanding of Data Integration Patterns and Tooling including ELT/ETL, EII, Replication, Event Streaming and Virtualization to support batch and real-time data needs.

  • Has or develops understanding of 4-6 subject areas/domains of data.

  • Provides a Strong Agile Lean Servant-Leader Model.

  • Exceptional analytical, conceptual, and problem-solving skills.

#LI-Hybrid

Compensation Range:

Pay Range - Start:

$112,210.00

Pay Range - End:

$208,390.00

Geographic Specific Pay Structure:

215 - Structure 110: 123,410.00 USD - 229,190.00 USD 215 - Structure 115: 129,010.00 USD - 239,590.00 USD

We believe in fairness and transparency. It’s why we share the salary range for most of our roles. However, final salaries are based on a number of factors, including the skills and experience of the candidate; the current market; location of the candidate; and other factors uncovered in the hiring process. The standard pay structure is listed but if you’re living in California, New York City or other eligible location, geographic specific pay structures, compensation and benefits could be applicable, click here to learn more.

Grow your career with a best-in-class company that puts our clients' interests at the center of all we do. Get started now!

Northwestern Mutual is an equal opportunity employer who welcomes and encourages diversity in the workforce. We are committed to creating and maintaining an environment in which each employee can contribute creative ideas, seek challenges, assume leadership and continue to focus on meeting and exceeding business and personal objectives.

FIND YOUR FUTURE

We’re excited about the potential people bring to Northwestern Mutual. You can grow your career here while enjoying first-class perks, benefits, and our commitment to a culture of belonging.

  • Flexible work schedules
  • Concierge service
  • Comprehensive benefits
  • Employee resource groups
PandoLogic. Category:Technology, Keywords:Data Engineer, Location:Milwaukee, WI-53205
View Now

Lead Data Engineer

53205 Milwaukee, Wisconsin Northwestern Mutual

Posted today

Job Viewed

Tap Again To Close

Job Description

Primary Duties & Responsibilities

  • Apply engineering best practices in order to analyze, design, develop, deploy and support software solutions.

  • Influence team members through lean agile leadership.

  • Mentor on Software Craftsmanship and Quality Standards.

  • Develop software using continuous Deployment and integration practices.

  • Participate in an Agile implementation and maintenance of source control and release procedures.

  • Participate in Code Reviews and feedback to the team.

  • Mentor technical members of the team.

  • Contribute to a collaborative work environment in which all team members are respected regardless of their individual differences and are motivated to improve both their individual and team contributions.

  • Identify data quality issues and their root causes.

  • Propose fixes and design data audits.


Qualifications

  • Bachelor's Degree.

  • 6-8 years of professional experience.

  • At least 6 years of professional data engineering, software engineering, debugging, analysis, testing and software documentation experience.

  • Advanced programming skills.

  • Code Knowledge: Python, SQL, HCL (Terraform), Apache Spark.

  • Experience with Agile methodologies/DevOps environment.

  • Experience with AWS environment (Redshift, AWS Glue).

  • Strong understanding of database structures, theories, principles, and practices.

  • Strong understanding of Data Quality and Data Concepts.

  • Strong understanding of Data Integration Patterns and Tooling including ELT/ETL, EII, Replication, Event Streaming and Virtualization to support batch and real-time data needs.

  • Has or develops understanding of 4-6 subject areas/domains of data.

  • Provides a Strong Agile Lean Servant-Leader Model.

  • Exceptional analytical, conceptual, and problem-solving skills.

#LI-Hybrid

Compensation Range:

Pay Range - Start:

$112,210.00

Pay Range - End:

$208,390.00

Geographic Specific Pay Structure:

215 - Structure 110: 123,410.00 USD - 229,190.00 USD 215 - Structure 115: 129,010.00 USD - 239,590.00 USD

We believe in fairness and transparency. It’s why we share the salary range for most of our roles. However, final salaries are based on a number of factors, including the skills and experience of the candidate; the current market; location of the candidate; and other factors uncovered in the hiring process. The standard pay structure is listed but if you’re living in California, New York City or other eligible location, geographic specific pay structures, compensation and benefits could be applicable, click here to learn more.

Grow your career with a best-in-class company that puts our clients' interests at the center of all we do. Get started now!

Northwestern Mutual is an equal opportunity employer who welcomes and encourages diversity in the workforce. We are committed to creating and maintaining an environment in which each employee can contribute creative ideas, seek challenges, assume leadership and continue to focus on meeting and exceeding business and personal objectives.

FIND YOUR FUTURE

We’re excited about the potential people bring to Northwestern Mutual. You can grow your career here while enjoying first-class perks, benefits, and our commitment to a culture of belonging.

  • Flexible work schedules
  • Concierge service
  • Comprehensive benefits
  • Employee resource groups
PandoLogic. Category:Technology, Keywords:Data Engineer, Location:Milwaukee, WI-53205
View Now

Lead Data Engineer

32806 Orlando, Florida NBC Universal

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

JOB SUMMARY:
Responsible for technical design, writing, support and operations of efficient, scalable, and extensible data integrations and ingestions. Implement effective solutions from the ground up and investigate anomalies in a mature running data platform and environment. Work with business, developers, analysts, architecture and product owners to develop data integration and ingestion solutions that are critical to the enterprise analytics, reporting and application environments leveraged by all areas of the business. Perform all data platform related configuration, software and server installations, upgrades and patching partnering with the necessary Infrastructure, IT Security and other teams as needed.
MAJOR RESPONSIBILITIES:
+ Implement enhancements for prioritized data integration and ingestions work efforts partnering with the business to ensure they meet the specified requirements.
+ Implement critical and non-critical system data integration and ingestion fixes for the data platform and environment. Ensuring root cause resolution to identified problems. Monitor and support the campaign management environment and processes in order to meet the daily SLA.
+ Recommend and code efficient and effective data integration and ingestion solutions for challenging problems for medium to large work efforts of medium to high complexity. Translate business requirements, data mappings into data integrations and ingestions code solutions.
+ Support Release and Change Management processes along with other UPT Compliance initiatives. Work effectively with Technology Operations/Infrastructure teams to ensure continued operations and maintenance of the data integrations and ingestions as well as the data platform and environment.
+ Understands and actively participates in Environmental, Health & Safety responsibilities by following established UO policy, procedures, training and team member involvement activities.
+ Performs other duties as assigned.
EDUCATION:
+ Technical degree, Bachelor's degree;
+ or highly relevant equivalent experience is required.
EXPERIENCE:
+ 7+ years of demonstrated experience working as part of large Information Technology teams and/or consulting organizations partnering with clients/business groups in a role developing and supporting a complex data environment; or equivalent combination of education and experience. Strong understanding of software development lifecycle
+ Experience in a transaction-based environment is a MUST
+ Proficient with scripting languages, data ingestion tools and corresponding tools, preferably Python, Pip, Pipenv, Bash, Scala, Spark, PySpark ScalaSpark, NIFI, and Java Script, and one object-oriented language like Java/C#
+ Able to work in and with Cloud and non-cloud technologies like AWS, Azure, Hadoop etc.
+ Experience with one or more relational databases/data technologies like DB2, SQL Server, Snowflake. Able to write and ready complex SQL, stored procedures and leverage backend databases. Should be able to triage database performance issues with SQL being sent to the database. Able to read and explain plans, and understand the complexity.
+ Experience working with scheduling, automation, file transfer, monitoring, alerting, notification and logging tools like Airflow, RunDeck, SFTP etc.
+ Experience working in Linux environment
+ Experience with source control management such as Git and/or SVN
+ Strong problem solving skills, and the ability to communicate complex concepts clearly and accurately
+ Familiarity with no-SQL databases like Couch, MongoDB, Hbase or Cassandra
+ Knowledge of Data Science, Analytics and Business Intelligence/Reporting practices and tools as it pertains to data platforms and environments (R-Studio, Jupyter, Zeppelin, Tableau or DsX)
+ Experience interacting with Kafka and API/Service programming and transactional databases
+ Experience with principles of data governance and quality as well as tools used (i.e. Ranger, Atlas)
+ Understanding of containers, resource management or YARN is desirable
+ Able to perform software and server installations, patching and upgrades.
+ Participate in an on-call rotation and available to work off-hours, holidays and weekends.
+ Must be able to partner with other teams and developers effectively.
+ Strong knowledge of systems development and project management Agile methodologies/processes.
+ Demonstrated ability to produce high quality technical documentation.
+ Able to quickly meet changing business requirements.
+ Able to complete work items, validate the results and present deliverable to the business for review with minimal to no defects.
+ Able to understand and interpret Entity-Relationship, logical and physical data models.
+ Work with change management processes to ensure smooth migration between dev, QA and production environments.
+ Monitor and maintain all the system processes.
+ Ensure system issues are resolved in a timely manner.
+ Strong interpersonal skills, with a demonstrated ability to make effective decisions while working through complex system issues.
+ Must be able to utilize and effectively communicate functional and technical components of an initiative to applicable parties both verbally and through documentation.
+ Coordinate the necessary operations documentation and standards required for compliance and identified best practices.
+ Problem and Change Management ITIL ServiceNow toolset in tracking and providing status on support work activities.
+ Attention to detail, good analytical and problem solving skills and critical thinking.
+ Self-starter/motivator with a proactive, agile and strategic mindset. Able to work independently.
+ Provide work estimates on break-fixes and enhancements.
+ Facilitate and lead meetings with end users to discuss issues and open work items.
+ Keeps management, team members and business stakeholders informed of critical issues, status, changes, etc.
+ Willingness to learn new technologies, tools, and approaches to problem-solving
Your talent, skills and experience will be rewarded with a competitive compensation package.
Universal is not accepting unsolicited assistance from search firms for this employment opportunity. All resumes submitted by search firms to any employee at Universal Orlando via-email, the Internet or in any form and/or method without a valid written Statement of Work in place for this position from Universal Orlando HR/Recruitment will be deemed the sole property of Universal Orlando. No fee will be paid in the event the candidate is hired by Universal Orlando as a result of the referral or through other means.
Universal Orlando Resort. Here you can.
Universal Orlando is an equal opportunity employer. Universal elements and all related indicia TM & © 2025 Universal Studios. All rights reserved. EOE
View Now

Lead, Data Engineer

32919 Melbourne, Florida L3Harris

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

L3Harris is dedicated to recruiting and developing high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers' mission and quest for professional growth. L3Harris provides an inclusive, engaging environment designed to empower employees and promote work-life success. Fundamental to our culture is an unwavering focus on values, dedication to our communities, and commitment to excellence in everything we do.
L3Harris Technologies is the Trusted Disruptor in the defense industry. With customers' mission-critical needs always in mind, our employees deliver end-to-end technology solutions connecting the space, air, land, sea and cyber domains in the interest of national security.
Job Title: Lead, Data Engineer
Job Code: 29874
Job Location: Melbourne, FL (On-Site)
Job Schedule: 9/80: Employees work 9 out of every 14 days - totaling 80 hours worked - and have every other Friday off
Job Description:
L3Harris Enterprise Data and AI team is seeking a Data Engineer with experience in managing enterprise-level data life cycle processes. This role includes overseeing data ETL/ELT pipelines, ensuring adherence to data standards, maintaining data frameworks, conducting data cleansing, orchestrating data pipelines, and ensuring data consolidation. The selected individual will play a pivotal role in maintaining ontologies, building scalable data solutions, and developing dashboards to provide actionable insights for the enterprise within Palantir Foundry.
This position will support the company's modern data platform, Unified Data Layer, focusing on data pipeline development and maintenance, data platform design, documentation, and user training. The goal is to ensure seamless access to data for all levels of the organization, empowering decision-makers with clean, reliable data.
Essential Functions:
+ Design, build, and maintain robust data pipelines to ensure reliable data flow across the enterprise.
+ Maintain data pipeline schedules, orchestrate workflows, and monitor the overall health of data pipelines to ensure continuous data availability.
+ Create, update, and optimize data connections, datasets, and transformations to align with business needs.
+ Troubleshoot and resolve data sync issues, ensuring consistent and correct data flow from source systems.
+ Collaborate with cross-functional teams to uphold data quality standards and ensure accurate data is available for use.
+ Utilize Palantir Foundry to establish data connections to source applications, extract and load data, and design complex logical data models that meet functional and technical specifications.
+ Develop and manage data cleansing, consolidation, and integration mechanisms to support big data analytics at scale.
+ Build visualizations using Palantir Foundry tools and assist business users with testing, troubleshooting, and documentation creation, including data maintenance guides.
Qualifications:
+ Bachelor's Degree and minimum 9 years prior Palantir experience or Graduate Degree and a minimum of 7 years of prior Palantir experience In lieu of degree, minimum 13 years of prior Palantir experience.
+ 4+ years of experience with design, development of Data Pipelines in Palantir Foundry Pipeline Builder or Code Repo, PySpark and Spark SQL, and data build/sync schedule deployment in Palantir
+ 4+ years of experience with Data Pipeline development or ETL tools such as Palantir Foundry, Azure Data Factory, SSIS or Python
+ 5+ Years of overall Data Integration experience in Palantir or similar data integration tools.
Preferred Additional Skills:
+ Understanding of BI (Business Intelligence) & DW (Data Warehouse) development methodologies.
+ Experience with Snowflake cloud data platform including but not limited to hands-on experience with Snowflake
+ Experience with Python, Pandas, Databricks, JavaScript, Typescript or other scripting languages
+ Experience in ETL tools such as Palantir Foundry, ADF (Azure Data Factory), SSIS, Informatica or Talend is preferable
+ Working knowledge to connect and extract data from various ERP applications such as Oracle EBS, SAP ECC/S4, Deltek Costpoint, REST API, and more.
+ Experience with AI tools such as OpenAI, Palantir AIP, Snowflake Cortex or similar.
#LI-NR1
L3Harris Technologies is proud to be an Equal Opportunity Employer. L3Harris is committed to treating all employees and applicants for employment with respect and dignity and maintaining a workplace that is free from unlawful discrimination. All applicants will be considered for employment without regard to race, color, religion, age, national origin, ancestry, ethnicity, gender (including pregnancy, childbirth, breastfeeding or other related medical conditions), gender identity, gender expression, sexual orientation, marital status, veteran status, disability, genetic information, citizenship status, characteristic or membership in any other group protected by federal, state or local laws. L3Harris maintains a drug-free workplace and performs pre-employment substance abuse testing and background checks, where permitted by law.
Please be aware many of our positions require the ability to obtain a security clearance. Security clearances may only be granted to U.S. citizens. In addition, applicants who accept a conditional offer of employment may be subject to government security investigation(s) and must meet eligibility requirements for access to classified information.
By submitting your resume for this position, you understand and agree that L3Harris Technologies may share your resume, as well as any other related personal information or documentation you provide, with its subsidiaries and affiliated companies for the purpose of considering you for other available positions.
L3Harris Technologies is an E-Verify Employer. Please click here for the E-Verify Poster in English ( or Spanish ( . For information regarding your Right To Work, please click here for English ( or Spanish ( .
View Now

Lead Data Engineer

32830 Lake Buena Vista, Florida The Walt Disney Company

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

The Disney Decision Science + Integration (DDSI) is a consulting team that supports clients across The Walt Disney Company, including Disney Experiences (Parks & Resorts worldwide, Cruise Line, Consumer Products, etc.), Disney Entertainment (ABC, The Walt Disney Studios, Disney Theatrical, Disney Streaming Services, etc.), ESPN, and Corporate Finance. Key partners to the DDSI organization include Marketing, Finance, Business Development, Research, and Operations. We develop, analyze, and execute strategies and improve the value proposition for our Guests, Cast Members, and Shareholders. The team leverages technology, data analytics, optimization, statistical and econometric modeling to explore opportunities, shape business decisions and drive business value.
**What You Will Do**
You will be responsible for planning and leading research and development related to advanced analytic data solutions, leveraging GenAI. You will work with business and technology leaders to understand scope and requirements, business needs, and data from across the Disney company in order to design and deliver the data pipelines necessary for our solutions. You will partner with the Decision Science Products, Decision Science, and client teams on critical projects. Other activities include planning, estimating, design, development, testing, production rollout and sustainment activities. You will also need to consult and collaborate with project team members, lead design reviews, do hands-on development, and communicate with colleagues and leaders.
**Required Qualifications & Skills**
+ 7+ years overall experience in a data engineering development capacity using a multiple environments (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion
+ Experience with a variety of GenAI models, tools, and concepts
+ 3+ years using, designing and building relational databases (preferably Snowflake or PostgreSQL)
+ 3+ years of experience leading and deploying code using a source control product such as GitLab/GitHub
+ 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4
+ Multiple years of experience with ELT/ETL data pipeline development and maintenance
+ Multiple years of shown experience and expertise using SQL and Python
+ Experience using containerization technologies such as Docker or Kubernetes
+ Knowledgeable on cloud architecture and product offerings, preferably AWS
+ Understanding of Knowledge Graphs, Data Mesh, and other data sharing platforms
+ Experience translating project scope and high-level requirements into technical data engineering tasks
+ Experience defining solutions to sophisticated data engineering problems in support of advanced analytic processes
+ Experience collaborating with multiple project teams in a fast-paced environment
+ Experience with defining and estimating level-of-effort data engineering activities
+ Experience with project and sprint planning
+ Ability to communicate technical concepts and solutions to non-technical team members
+ Experience designing and building data structures to support requirements
**Preferred Qualifications**
+ Experience leading development of GenAI based systems including model selection, pipeline orchestration and deployment strategies
+ Experience defining GenAI architectures
+ Knowledgeable with Disney Parks attendance, reservations and/or products
+ Experience with cloud based technologies, preferably AWS EMR, EC2, and S3
+ Experience with advanced Snowflake offerings such as Snowpark, Data Exchange, Data Marketplace and Snowpipe
**Education**
+ Bachelor's degree in computer science, Information Systems, Software, Electrical or ElectronicsEngineering, or comparable field of study and/or equivalent work experience
+ Master's degree preferred in computer science, Information Systems, Software, Electrical or ElectronicsEngineering, or comparable field of study and/or equivalent work experience
#DISNEYTECH
#DisneyAnalytics
**Job ID:**
**Location:** Lake Buena Vista,Florida
**Job Posting Company:** The Walt Disney Company (Corporate)
The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.
View Now

Lead Data Engineer

90407 Santa Monica, California The Walt Disney Company

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

**Disney Entertainment and ESPN Product & Technology**
Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and advance the technological backbone for Disney's media business globally.
The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company's media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world. 
Here are a few reasons why we think you'd love working here:
+ **Building the future of Disney's media:** Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.
+ **Reach, Scale & Impact:** More than ever, Disney's technology and products serve as a signature doorway for fans' connections with the company's brands and stories. Disney+. Hulu. ESPN. ABC. ABC News.and many more. These products and brands - and the unmatched stories, storytellers, and events they carry - matter to millions of people globally. 
+ **Innovation:** We develop and implement groundbreaking products and techniques that shape industry norms, and solve complex and distinctive technical problems.
**Commerce, Data & Identity**
+ Commerce, Data & Identity provides the core product management functions for areas crucial to Disney's media businesses. These include initiatives and products that power digital commerce, identity, and growth, as well as those that reach uniquely across The Walt Disney Company enterprise, such as messaging and privacy, among others. Additionally, it is responsible for the data engineering, science, and products for Disney Entertainment & ESPN, along with their interconnection with other parts of The Walt Disney Company.
**About The Role**
The Lead Data Engineer partners with business, analytics, and infrastructure teams to design and build data pipelines for Content performance metrics. Responsibilities include sourcing internal and external data, designing table structures, defining ETL strategies, and implementing automated data quality checks. Additionally, this role mentors junior data engineers in pipeline development.
**Responsibilities**
+ Lead the successful design and implementation of complex technical problems.
+ Lead and contribute to the design and growth of our Data Products and Data Warehouses around Content movements and metrics.
+ Use sophisticated analytical thought to exercise judgement and identify innovative solutions.
+ Partner with technical and non-technical colleagues to understand data and reporting requirements, and Collaborate with Data Product Managers, Data Architects and other Data Engineers to design, implement, and deliver successful data solutions
+ Design table structures and define ETL pipelines to build performant Data solutions that are reliable and scalable in a fast growing data ecosystem.
+ Develop Data Quality checks
+ Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
+ Serve as an advanced resource to other Data Engineers on the team, and mentor and coach more junior members of the team helping to improve their skills, knowledge, and productivity.
**Basic Qualifications**
+ 7+ years of data engineering experience developing large data pipelines.
+ Strong understanding of data modeling principles including Dimensional modeling, data normalization principles.
+ Good understanding of SQL Engines and able to conduct advanced performance tuning.
+ Ability to think strategically, analyze and interpret market and consumer information.
+ Strong communication skills - written and verbal presentations.
+ Excellent conceptual and analytical reasoning competencies.
+ Comfortable working in a fast-paced and highly collaborative environment.
+ Familiarity with Agile Scrum principles and ceremonies
**Preferred Qualifications**
+ 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, required.
+ 5+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
+ 3+ years of experience programming languages (e.g. Python, Pyspark), preferred.
+ 3+ years of experience with data orchestration/ETL tools (Airflow, Nifi), preferred.
+ Experience with Snowflake, Databricks/EMR/Spark & Airflow a plus.
**Required Education**
+ Bachelor's Degree in Computer Science, Information Systems or related field, or equivalent work experience.
+ Master's Degree a plus.
**Additional Information**
#DISNEYTECH
#CDI
The hiring range for this position in Santa Monica, CA is $152,200 - $04,100 per year, in San Francisco, CA is 166,800 - 223,600 per year, in Seattle, WA is 159,500 - 213,900 per year, and in New York, NY is 159,500 - 213,900 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
**Job ID:**
**Location:** Santa Monica,California
**Job Posting Company:** Disney Entertainment and ESPN Product & Technology
The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.
View Now

Lead Data Engineer

92604 Woodbridge, California AbbVie

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

Company Description
At Allergan Aesthetics, an AbbVie company, we develop, manufacture, and market a portfolio of leading aesthetics brands and products. Our aesthetics portfolio includes facial injectables, body contouring, plastics, skin care, and more. Our goal is to consistently provide our customers with innovation, education, exceptional service, and a commitment to excellence, all with a personal touch. For more information, visit Follow Allergan Aesthetics on LinkedIn.
Allergan Aesthetics | An AbbVie Company
Job Description
As the Lead Data Engineer,you will report to the
Engineer Manager (Data Services) and continuously collaborate closely with key stakeholders across the business to solve critical technical challenges.
Key Responsibilities:
Take ownership for achieving objectives and key results for your team, oversee & own technical solutions, communicate schedule, status, and milestones
Collaborate with cross functional partners (Product Managers, Data Scientists, Machine Learning Engineers, Software Engineers, and Business teams) to build data products
Communicate effectively with both technical and non-technical stakeholders. Translate technical concepts into clear, accessible terms.
Develop, optimize, and maintain complex ETL processes for data movement and transformation
Review code and provide technical guidance to ensure adherence to high-quality standards and best practices in data engineering
Develop APIs and microservices to expose and integrate data products with software systems
Implement monitoring, logging, and alerting systems to proactively identify and resolve issues
Ensure data quality, security, and compliance with relevant regulations and standards
Stay current with industry trends, emerging technologies, and best practices in data engineering. Foster a culture of continuous learning and skill development within the team
Qualifications
Required Experience & Skills
+ BS, MS, or PhD in Computer Science, Mathematics, Statistics, Engineering, Operations Research, or a related quantitative field
+ 7+ years of experience as a Data Engineer or Software Engineer developing and maintaining data pipelines, infrastructure and architecture
+ Strong programming skills in Python with a solid understanding of core computer science principles
+ Knowledge of relational and dimensional data modeling for building data products.
+ Experience with data quality checks and data monitoring solutions.
+ Experience orchestrating complex workflows and data pipelines using Airflow or similar tools
+ Proficiency with Git, CI/CD pipelines, Docker, and Kubernetes
+ Experience architecting solutions on AWS or equivalent public cloud platforms
+ Experience developing data APIs, microservices, and event-driven systems to integrate data products
+ Strong interpersonal and verbal communication skills
+ Proven leadership experience with the ability to mentor and guide a team
Preferred Experience & Skills:
+ Familiarity with data mesh concepts.
+ Domain knowledge in recommender systems, fraud detection, personalization, and marketing science.
+ Understanding of vector databases, knowledge graphs, and other advanced data organization techniques.
+ Hands-on experience with tools such as Snowflake, Postgres, DynamoDB, Kafka, Fivetran, dbt, Airflow, Docker, Kubernetes, SageMaker, Datadog, PagerDuty, data observability tools, and data governance tools.
Additional Information
Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:
+ The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.
+ We offer a comprehensive package of benefits including paid time off (vacation, holidays, sick), medical/dental/vision insurance and 401(k) to eligible employees.
+ This job is eligible to participate in our short-term incentive programs.
+ This job is eligible to participate in our long-term incentive programs
Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company's sole and absolute discretion, consistent with applicable law.
AbbVie is an equal opportunity employer and is committed to operating with integrity, driving innovation, transforming lives and serving our community.  Equal Opportunity Employer/Veterans/Disabled.
US & Puerto Rico only - to learn more, visit & Puerto Rico applicants seeking a reasonable accommodation, click here to learn more:
$137,500 - $261,000
View Now
Be The First To Know

About the latest Lead data engineer Jobs in United States !

Lead Data Engineer

30309 Midtown Atlanta, Georgia WestRock Company

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

Our technology organization is transforming how we work at WestRock. We align with our businesses to deliver innovative solutions that:
* Address specific business challenges, integrate processes, and create great experiences
* Connect our work to shared goals that propel WestRock forward in the Digital Age
* Imagine how technology can advance the way we work by using disruptive technology
We are looking for forward thinking technologists that can accelerate our focus areas such as building stronger foundational technology capabilities, reducing complexity, employing digital transformation concepts, and leveraging disruptive technology.
As a Lead Data Engineer, you will play a pivotal role in building and scaling modern data infrastructure that powers decision-making across production, supply chain, and operations. Helps to define and analyze business requirements for Enterprise scale reports. Analyzes and evaluates business use cases for data engineering problems and helps design and develop processing solutions with ETL Cloud based technologies.
How you will impact WestRock:
* Architect and implement scalable data pipelines using Palantir Foundry (pipelines, workshops, ontology) to unify and transform operational data.
* Design and develop robust data workflows using Python, Apache Airflow, and Apache Spark to support real-time and batch processing needs.
* Build and deploy solutions on cloud platforms (AWS or Azure), ensuring high availability, security, and performance.
* Collaborate with data scientists, analysts, and operations teams to deliver actionable insights and operational tooling.
* Define and enforce data engineering best practices, including CI/CD automation, version control (Git), and testing strategies.
* Mentor junior developers, conduct code reviews, and help shape the technical roadmap for the data platform.
What you need to succeed:
* Education: Bacheloru2019s degree in computer science or similar
* At least 6 years of strong Data Engineering experience
* Hands-on experience with Palantir Foundry, including pipelines, ontology modeling, and workshop development.
* Strong programming skills in Python or Java, with experience building and maintaining production-grade data pipelines.
* Proficiency in Apache Airflow and Apache Spark for workflow orchestration and large-scale data processing.
* Proven experience deploying data solutions on AWS or Azure, with strong understanding of cloud-native services.
* Familiarity with Git for version control and CI/CD pipelines for automated testing and deployment.
* Demonstrated ability to mentor junior engineers, lead projects, and work independently in a fast-paced environment.
* Good communication skills, with the ability to collaborate effectively across technical and non-technical teams.
* Good analytical and troubleshooting abilities.
What we offer:
* Corporate culture based on integrity, respect, accountability and excellence
* Comprehensive training with numerous learning and development opportunities
* An attractive salary reflecting skills, competencies and potential
* A career with a global packaging company where Sustainability, Safety and Inclusion are business drivers and foundational elements of the daily work.
Smurfit Westrock (NYSE:SW) is a global leader in sustainable paper and packaging solutions. We are materials scientists, packaging designers, mechanical engineers and manufacturing experts with a shared purpose: Innovate Boldly. Package Sustainably. Guided by our values of safety, loyalty, integrity, and respect, we use leading science and technology to move fiber-based packaging forward.
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by state or federal law.
View Now

Lead Data Engineer

30009 Alpharetta, Georgia ADP

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

**ADP is hiring a Lead Data Engineer in our Alpharetta, GA office. This is a hybrid role.**
+ _Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day?_
+ _Are you looking to join a dynamic, inclusive team environment with a culture of collaboration and belonging?_
Well, this may be the role for you.
As a Lead Data Engineer, you will spearhead the design and delivery of a data hub/marketplace aimed at providing curated client service data to internal data consumers, including analysts, data scientists, analytic content authors, downstream applications, and data warehouses. You will develop a service data hub solution that enables internal data consumers to create and maintain data integration workflows, manage subscriptions, and access content to understand data meaning and lineage. You will design and maintain enterprise data models for contact center-oriented data lakes, warehouses, and analytic models (relational, OLAP/dimensional, columnar, etc.). You will collaborate with source system owners to define integration rules and data acquisition options (streaming, replication, batch, etc.). You will work with data engineers to define workflows and data quality monitors. You will perform detailed data analysis to understand the content and viability of data sources to meet desired use cases and help define and maintain enterprise data taxonomy and data catalog. This role requires clear, compelling, and influential communication skills. You will mentor developers and collaborate with peer architects and developers on other teams.
**TO SUCCEED IN THIS ROLE:**
+ Ability to define and design complex data integration solutions with general direction and stakeholder access.
+ Capability to work independently and as part of a global, multi-faceted data warehousing and analytics team.
+ Advanced knowledge of cloud-based data engineering and data warehousing solutions, especially AWS, Databricks, and/or Snowflake.
+ Highly skilled in RDBMS platforms such as Oracle, SQLServer.
+ Familiarity with NoSQL DB platforms like MongoDB.
+ Understanding of data modeling and data engineering, including SQL and Python.
+ Strong understanding of data quality, compliance, governance and security.
+ Proficiency in languages such as Python, SQL, and PySpark.
+ Experience in building data ingestion pipelines for structured and unstructured data for storage and optimal retrieval.
+ Ability to design and develop scalable data pipelines.
+ Knowledge of cloud-based and on-prem contact center technologies such as Salesforce.com, ServiceNow, Oracle CRM, Genesys Cloud, Genesys InfoMart, Calabrio Voice Recording, Nuance Voice Biometrics, IBM Chatbot, etc., is highly desirable.
+ Experience with code repository and project tools such as GitHub, JIRA, and Confluence.
+ Working experience with CI/CD (Continuous Integration & Continuous Deployment) process, with hands-on expertise in Jenkins, Terraform, Splunk, and Dynatrace.
+ Highly innovative with an aptitude for foresight, systems thinking, and design thinking, with a bias towards simplifying processes.
+ Detail-oriented with strong analytical, problem-solving, and organizational skills.
+ Ability to clearly communicate with both technical and business teams.
+ Knowledge of Informatica PowerCenter, Data Quality, and Data Catalog is a plus.
+ Knowledge of Agile development methodologies is a plus.
+ Having a Databricks data engineer associate certification is a plus but not mandatory.
**Data Engineer Requirements:**
+ Bachelor's degree in computer science, information technology, or a similar field.
+ 8+ years of experience integrating and transforming contact center data into standard, consumption-ready data sets incorporating standardized KPIs, supporting metrics, attributes, and enterprise hierarchies.
+ Expertise in designing and deploying data integration solutions using web services with client-driven workflows and subscription features.
+ Knowledge of mathematical foundations and statistical analysis.
+ Strong interpersonal skills.
+ Excellent communication and presentation skills.
+ Advanced troubleshooting skills.
**YOU'LL LOVE WORKING HERE BECAUSE YOU CAN:**
+ **Have courageous team collaboration.** Courage comes from how associates are willing to have difficult conversations, speak up, be an owner, and challenge one another's ideas to find the best solution.
+ **Deliver at epic scale.** We deliver real user outcomes using strong judgment and good instincts. We're obsessed with the art of achieving simplicity with a focus on client happiness and productivity.
+ **Be surrounded by curious learners.** We align ourselves with other smart people in an environment where we grow and elevate one another to the next level. We encourage our associates to listen, stay agile, and learn from mistakes.
+ **Act like an owner - doer.** Mission-driven and committed to leading change, you will be encouraged to take on any challenge and solve complex problems. No tasks are beneath or too great for us. We are hands-on and willing to master our craft.
+ **Give back to others.** Always do the right thing for our clients and our community and humbly give back to the community where we live and work. Support our associates in times of need through ADP's Philanthropic Foundation.
+ **Join a company committed to equality and equity.** Our goal is to impact lasting change through our actions.
What are you waiting for? **Apply today!**
Find out why people come to ADP and why they stay: version: )
#LI-MS2
**A little about ADP:** We are a comprehensive global provider of cloud-based human capital management (HCM) solutions that unite HR, payroll, talent, time, tax and benefits administration and a leader in business outsourcing services, analytics, and compliance expertise. We believe our people make all the difference in cultivating a down-to-earth culture that embraces our core values, welcomes ideas, encourages innovation, and values belonging. We've received recognition for our work by many esteemed organizations, learn more at ADP Awards and Recognition ( .
**Diversity, Equity, Inclusion & Equal Employment Opportunity at ADP:** ADP is committed to an inclusive, diverse and equitable workplace, and is further committed to providing equal employment opportunities regardless of any protected characteristic including: race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, protected veteran status or disability. Hiring decisions are based upon ADP's operating needs, and applicant merit including, but not limited to, qualifications, experience, ability, availability, cooperation, and job performance.
**Ethics at ADP:** ADP has a long, proud history of conducting business with the highest ethical standards and full compliance with all applicable laws. We also expect our people to uphold our values with the highest level of integrity and behave in a manner that fosters an honest and respectful workplace. Click to learn more about ADP's culture and our full set of values.
View Now

Lead Data Engineer

53786 Madison, Wisconsin Centene Corporation

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility.
**Position Purpose:** Uses advanced expertise and knowledge to lead the development and operationalization of data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Works closely with the DevSecOps Engineer during continuous integration and continuous deployment.
+ Leads the design and implementation of standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.)
+ Leads data engineers and provides advanced experience in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics
+ Leads the team using advanced experience and knowledge in the design, development, and maintenance of real-time processing applications and real-time data pipelines
+ Ensure quality of technical solutions as data moves across Centene's environments
+ Provides advanced knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions
+ Develops, constructs, tests, and maintains architectures using advanced programming language and tools
+ Leads and implements ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated
+ Performs other duties as assigned
+ Complies with all policies and standards
**Education/Experience:** A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and requires 5 - 7 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position.
**Technical Skills:**
+ One or more of the following skills are desired.
+ SQL including building and running queries
+ Power BI
+ Data Wireframing
Pay Range: $100,900.00 - $186,800.00 per year
Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility.
Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law.
Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act
View Now
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Lead Data Engineer Jobs