93 Etl Processes jobs in New York
Manager, Data Engineering
Posted 9 days ago
Job Viewed
Job Description
Job DescriptionJob Description
Healthcare quality is declining and soaring costs are crushing American families and businesses. At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique incentive model that's reshaping the healthcare economy to ensure everyone can afford high quality care. By providing organizations relief from surging healthcare costs, we've experienced rapid adoption in the market and have more than doubled our revenue annually over the last 5 years, becoming the fastest growing company in our space. To support our continued growth, we're expanding our team by over 50% each year, seeking exceptional talent to shape our unique, award winning culture (for example, USA Today Top Workplaces 2025) designed to cultivate teamwork, trust, autonomy, exceptional results, and individual growth that creates an inflection point in your career.
About the role:
We are looking for an Engineering Manager to join and lead the team responsible for the systems that generate Garner's healthcare provider rankings. The ideal candidate for this role should have a high sense of ownership, be comfortable mentoring engineers of all levels, have experience with distributed systems, and be able to reliably deliver complex technical solutions. This role reports to the VP of Health Intelligence Engineering.
Where you will work:
This role will be based in our New York City office. You must be willing to work in the office 3 days per week on Tuesday, Wednesday and Thursday.
What you will do:
- Provide technical leadership and deliver new features aligned with Garner's strategic objectives
- Own and manage the core systems responsible for generating provider rankings
- Maintain high standards of quality while driving efficient, timely delivery
- Balance the development of new capabilities with the need to scale and optimize existing systems
- Collaborate across disciplines by identifying bottlenecks and risks, proposing mitigation, and communicating tradeoffs
- Champion user data privacy and security across all data initiatives
- Foster a high-performing, collaborative team culture through hands-on leadership, mentorship, and talent development
What you will bring to the team:
- 5+ years of hands-on engineering experience, with a focus on Big Data and distributed systems
- 1+ years of managing engineering teams, with a track record of building and mentoring high performing teams
- Expertise with batch data processing frameworks such as Hadoop, Spark, EMR, etc.
- Proficiency with Big Data technologies such as Argo, Apache iceberg, AWS glue, Spark, Metaflow, DBT, and Soda
- Exhibits strong ownership and a proactive mindset, with a proven ability to translate complex business needs into scalable, actionable technical roadmaps
- Demonstrated ability to operate effectively in dynamic, fast-paced startup environments, with a hands-on approach and a strong commitment to organizational success
- Preference for managing healthcare data standards (e.g. HIPAA, EDI)
- A desire to be a part of our mission to improve the U.S. healthcare system
Please note: we are unable to sponsor or take over sponsorship of an employment visa at this time.
Compensation Transparency:
The target salary range for this position is: $220,000 - $250,000. Individual compensation for this role will depend on various factors, including qualifications, skills, and applicable laws. In addition to base compensation, this role is eligible to participate in our equity incentive and competitive benefits plans, including but not limited to: flexible PTO, Medical/Dental/Vision plan options, 401(k), Teladoc Health and more.
Fraud and Security Notice:
Please be aware of recent job scam attempts. Our recruiters use getgarner.com email domain exclusively. If you have been contacted by someone claiming to be a Garner recruiter or a hiring manager from a different domain about a potential job, please report it to law enforcement here and to
Equal Employment Opportunity: Garner Health is proud to be an Equal Employment Opportunity employer and values in the workplace. We do not discriminate based upon , , , , (including , childbirth, reproductive health decisions, or related medical conditions), , , expression, , status as a protected veteran, status as an individual with a , genetic information, political views or activity, or other applicable legally protected characteristics.
Garner Health is committed to providing accommodations for qualified individuals with disabilities in our recruiting process. If you need assistance or an accommodation due to a , you may contact us at
Data Engineering Director
Posted 9 days ago
Job Viewed
Job Description
Bustle Digital Group (BDG) is seeking a Director of Data Engineering to lead, expand, and optimize our data infrastructure. In this role, you will drive the development of scalable data pipelines, enhance our storage and reporting systems, and support data-driven initiatives across our advertising, affiliate sales, and editorial content revenue streams. As the head of our data engineering team, you will play a pivotal role in shaping BDG's data strategy and fostering a culture of innovation and excellence.
What You'll Do
- Lead & Grow the Team: Build, mentor, and scale a high-performing data engineering team to develop data-driven products that fuel revenue growth and business intelligence.
- Drive Innovation & Best Practices: Design and implement best-in-class data systems and architecture, ensuring efficiency, scalability, and industry compliance.
- Foster a Culture of Ownership: Encourage self-directed, accountable teams that take initiative and collaborate effectively.
- Set Clear Objectives & Strategy: Define technical roadmaps, establish team goals, and align data initiatives with broader company objectives.
- Optimize Data Systems: Enhance our data pipelines, storage, and analytics capabilities to support real-time insights and predictive modeling.
- Mentor & Develop Talent: Provide technical and professional guidance to engineers at all levels, fostering career growth and leadership development.
- Experienced Technical Leader: Proven track record in leading cross-functional and distributed engineering teams.
- Strategic Thinker & Communicator: Strong organizational and stakeholder management skills with a user-centric approach.
- Agile Advocate: Hands-on experience implementing agile methodologies, particularly Kanban.
- Product-Driven Engineer: Experience developing data solutions for ad products, affiliate sales, or editorial platforms.
- Mentor & Coach : Passionate about guiding both senior and early-career engineers, helping them grow technically and professionally.
- Competitive Compensation & Equity: Market-leading pay with annual reviews and stock options.
- Unlimited PTO: Recharge and take the time you need.
- Comprehensive Health & Wellness: Medical, dental, and vision coverage for you and your dependents.
- Retirement Savings: 401(k) plan.
- Flexible Work Options: Work remotely or collaborate in our NYC office.
$165,000 - $190,000 a year
Compensation: Salary will be commensurate with experience and qualifications, with a competitive benefits package offered.
BDG is a leading independent media company with a diverse portfolio of respected publications, including Bustle, Nylon, W, and Inverse. We combine the best of traditional and digital media, creating engaging content that captivates over 115 million readers each month. Our business thrives on data-driven insights that power content monetization, advertising, and affiliate sales.
Ready to lead the future of data at BDG? Apply now and be part of our growing team!
Data Engineering Director
Posted 9 days ago
Job Viewed
Job Description
FanDuel Group is the premier mobile gaming company in the United States and Canada. FanDuel Group consists of a portfolio of leading brands across mobile wagering including: America's #1 Sportsbook, FanDuel Sportsbook; its leading iGaming platform, FanDuel Casino; the industry's unquestioned leader in horse racing and advance-deposit wagering, FanDuel Racing; and its daily fantasy sports product.
In addition, FanDuel Group operates FanDuel TV, its broadly distributed linear cable television network and FanDuel TV+, its leading direct-to-consumer OTT platform. FanDuel Group has a presence across all 50 states, Canada, and Puerto Rico.
The company is based in New York with US offices in Los Angeles, Atlanta, and Jersey City, as well as global offices in Canada and Scotland. The company's affiliates have offices worldwide, including in Ireland, Portugal, Romania, and Australia.
FanDuel Group is a subsidiary of Flutter Entertainment, the world's largest sports betting and gaming operator with a portfolio of globally recognized brands and traded on the New York Stock Exchange (NYSE: FLUT).
THE POSITION Our roster has an opening with your name on it
We are seeking an experienced and forward-thinking Director of Data Engineering to lead a team of technical leaders & engineers in designing and delivering scalable, reliable, and high-impact data solutions. This role is key to executing our data strategy, building data products that serve internal and external users, and enabling data-driven decision-making across the business.
The ideal candidate brings deep technical expertise, a customer-first mindset, and the ability to translate business needs into data engineering solutions. You'll lead a team of talented technical leaders & engineers while collaborating across product, analytics, and business functions to align on priorities and maximize value delivery.
If you're excited by this challenge and want to work within a dynamic company, then we'd love to hear from you.
In addition to the specific responsibilities outlined above, employees may be required to perform other such duties as assigned by the Company. This ensures operational flexibility and allows the Company to meet evolving business needs.
THE GAME PLAN
Everyone on our team has a part to play
Strategic & Cross-Functional Leadership
- Partner with product, analytics, and business stakeholders to define and prioritize data engineering initiatives aligned with strategic goals
- Translate high-level business objectives into actionable data engineering roadmaps and deliverables
- Contribute to the long-term vision for the data ecosystem, helping shape platform architecture and data product strategy
- Lead the design, development, and deployment of batch & real-time data pipelines, platforms, and products using modern, cloud-native technologies
- Champion data quality, governance, and observability across the data stack through automation, validation, and monitoring
- Ensure adherence to software engineering best practices, including CI/CD, testing, and scalable code standards
- Manage and mentor a team of data engineers and technical leaders, supporting both their technical and career growth
- Foster a culture of ownership, accountability, and continuous improvement
- Promote cross-functional collaboration and knowledge sharing within and beyond the data engineering team
- Improve development workflows to optimize productivity, delivery speed, and quality
- Drive efficiency and performance through effective resource planning and prioritization
- Partner with data governance, privacy, and security teams to ensure regulatory compliance and best practices in data handling
What we're looking for in our next teammate
- 8+ years of experience in data engineering, with 3+ years in a technical leadership or management role
- Proven experience building and managing robust, scalable data pipelines and platforms.
- Strong proficiency in modern data technologies (e.g., Spark, Airflow, dbt, Kafka, Fivetran, Databricks, Confluent)
- Experience working with cloud platforms such as AWS, GCP, or Azure
- Excellent communication skills with the ability to influence technical and non-technical audiences
- Demonstrated ability to lead high-performing teams and manage competing priorities in fast-paced environments
- Experience supporting analytics, data science, or product development teams in a data-driven organization
- Familiarity with data product thinking and customer-centric data delivery
- Understanding of machine learning workflows and advanced analytics pipelines
- Background in DTC, eCommerce, or B2C digital environments is a plus
PLAYER BENEFITS
We treat our team right
We offer amazing benefits above and beyond the basics. We have an array of health plans to choose from (some as low as $0 per paycheck) that include programs for fertility and family planning, mental health support, and fitness benefits. We offer generous paid time off (PTO & sick leave), annual bonus and long-term incentive opportunities (based on performance), 401k with up to a 5% match, commuter benefits , pet insurance, and more - check out all our benefits here: FanDuel Total Rewards . *Benefits differ across location, role, and level.
FanDuel is an equal opportunities employer and we believe, as one of our principles states, "We are One Team!". As such, we are committed to equal employment opportunity regardless of race, color, ethnicity, ancestry, religion, creed, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, or any other characteristic protected by state, local or federal law. We believe FanDuel is strongest and best able to compete if all employees feel valued, respected, and included.
The applicable salary range for this position is $94,000 - 267,300 USD, which is dependent on a variety of factors including relevant experience, location, business needs and market demand. This role may offer the following benefits: medical, vision, and dental insurance; life insurance; disability insurance; a 401(k) matching program; among other employee benefits. This role may also be eligible for short-term or long-term incentive compensation, including, but not limited to, cash bonuses and stock program participation. This role includes paid personal time off and 14 paid company holidays. FanDuel offers paid sick time in accordance with all applicable state and federal laws.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
#LI- Hybrid
Manager, Data Engineering
Posted 9 days ago
Job Viewed
Job Description
Healthcare quality is declining and soaring costs are crushing American families and businesses. At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique incentive model that's reshaping the healthcare economy to ensure everyone can afford high quality care. By providing organizations relief from surging healthcare costs, we've experienced rapid adoption in the market and have more than doubled our revenue annually over the last 5 years, becoming the fastest growing company in our space. To support our continued growth, we're expanding our team by over 50% each year, seeking exceptional talent to shape our unique, award winning culture (for example, USA Today Top Workplaces 2025) designed to cultivate teamwork, trust, autonomy, exceptional results, and individual growth that creates an inflection point in your career.
About the role:
We are looking for an Engineering Manager to join and lead the team responsible for the systems that generate Garner's national healthcare provider rankings. The ideal candidate for this role should have a high sense of ownership, be comfortable mentoring engineers of all levels, have experience with distributed systems, and be able to reliably deliver complex technical solutions. This role reports to the VP of Health Intelligence Engineering.
Where you will work:
This role will be based in our New York City office. You must be willing to work in the office 3 days per week on Tuesday, Wednesday and Thursday.
What you will do:
- Provide technical leadership and deliver new features aligned with Garner's strategic objectives
- Own and manage the core systems responsible for generating provider rankings
- Maintain high standards of quality while driving efficient, timely delivery
- Balance the development of new capabilities with the need to scale and optimize existing systems
- Collaborate across disciplines by identifying bottlenecks and risks, proposing mitigation, and communicating tradeoffs
- Champion user data privacy and security across all data initiatives
- Foster a high-performing, collaborative team culture through hands-on leadership, mentorship, and talent development
- 5+ years of hands-on engineering experience, with a focus on Big Data and distributed systems
- 1+ years of managing engineering teams, with a track record of building and mentoring high performing teams
- Expertise with batch data processing frameworks such as Hadoop, Spark, EMR, etc.
- Proficiency with Big Data technologies such as Argo, Apache iceberg, AWS glue, Spark, Metaflow, DBT, and Soda
- Exhibits strong ownership and a proactive mindset, with a proven ability to translate complex business needs into scalable, actionable technical roadmaps
- Demonstrated ability to operate effectively in dynamic, fast-paced startup environments, with a hands-on approach and a strong commitment to organizational success
- Preference for managing healthcare data standards (e.g. HIPAA, EDI)
- A desire to be a part of our mission to improve the U.S. healthcare system
Please note: we are unable to sponsor or take over sponsorship of an employment visa at this time.
Compensation Transparency:
The target salary range for this position is: $220,000 - $250,000. Individual compensation for this role will depend on various factors, including qualifications, skills, and applicable laws. In addition to base compensation, this role is eligible to participate in our equity incentive and competitive benefits plans, including but not limited to: flexible PTO, Medical/Dental/Vision plan options, 401(k), Teladoc Health and more.
Fraud and Security Notice:
Please be aware of recent job scam attempts. Our recruiters use getgarner.com email domain exclusively. If you have been contacted by someone claiming to be a Garner recruiter or a hiring manager from a different domain about a potential job, please report it to law enforcement here and to
Equal Employment Opportunity:
Garner Health is proud to be an Equal Employment Opportunity employer and values diversity in the workplace. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.
Garner Health is committed to providing accommodations for qualified individuals with disabilities in our recruiting process. If you need assistance or an accommodation due to a disability, you may contact us at
Manager, Data Engineering
Posted 9 days ago
Job Viewed
Job Description
CoLab is a fully integrated, cross-discipline team that provides best-in-class services in a fluid and modular way. With our clients at the center, we create brand movement at the speed of people's lives by connecting real-time data with world-class creative, content, and media in service of growth and Return on investment.
CoLab is a "power of one" solution, encompassing data, media, and production. By drawing from across the vast Publicis Groupe network, we are uniquely positioned to deliver innovation and specialized skills to our clients, as well as enriching opportunities and inclusive benefits to our employees. We pride ourselves on combining the atmosphere of a startup company with the stability and experience of a global leader.
Overview
Our team is looking for a high-performing Data Engineer who will be responsible for the design, development, implementation and on-going support of a data driven software platform. You enjoy and thrive in a fast-paced environment on multiple projects simultaneously, including both enhancements as well as new project development. The candidate must be a self-starter with a sense of urgency and a commitment to quality and professionalism.
Responsibilities
- Analyze ambiguous business requirements and partner with product team to provide a strategic solution
- Collaborate with frontend engineers to design or modify schema for optimal software performance
- Advanced database administration and development including stored procedures, user defined functions, triggers and ETL packages as well as security and roles
- Uphold quality standards and create monitoring tools to ensure high fidelity data
- Optimization and tuning of existing stored procedures to improve performance
- Troubleshoot database issues, identify root causes, and implement optimal solutions
- Extract, transform, and load data from multiple data sources using languages and tools such as Python and AWS Glue
- Design, Build, Test, Debug, Monitor, and Troubleshoot ETL and software processes in Python
- Recommend solutions to existing or anticipated issues
- Serve as an escalation point for any issues that may arise
- Design testing requirements and prepare test plans and test modules
- Ability to follow implementation standards, develop documentation and transfer of knowledge
- The following experience is a plus:
- Experience with Snowflake
- Experience with Business Intelligence software (Tableau, PowerBI)
- Experience and thorough understanding of a variety of APIs
- Experience supporting analytics and data science teams/tools (Pandas, R, Alteryx)
- Experience with front-end development
- 4+ years' experience with ETL and databases, (Redshift preferred)
- 4+ years' experience with Python
- Familiarity with cloud technologies such as Amazon Web Services (Redshift, S3, Glue, Lambda)
- Advanced PostgreSQL programming skills (stored procedures, functions, etc.)
- Experience with marketing data and digital media
- Experience with complex processing logic against large data sets
- Excellent data modelling skills and experience working with multiple datasets
- Possession of strong communication and presentation skills as well as an analytical mindset
- Good problem solving and testing skills
- Familiarity with code versioning tools such as Git
- Strong organizational skills & attention to detail
- Possess a desire to work for a fast-paced, results-based company
- Experience managing multiple projects simultaneously
- Self-driven/entrepreneurial spirit with the ability to think outside of the box
- Bachelor's Degree in Computer Sciences, Information Technology, or equivalent
Additional Information
Our Publicis Groupe motto "Viva La Différence" means we're better together, and we believe that our differences make us stronger. It means we honor and celebrate all identities, across all facets of intersectionality, and it underpins all that we do as an organization. We are focused on fostering belonging and creating equitable & inclusive experiences for all talent.
Publicis Groupe provides robust and inclusive benefit programs and policies to support the evolving and diverse needs of our talent and enable every person to grow and thrive. Our benefits package includes medical coverage, dental, vision, disability, 401K, as well as parental and family care leave, family forming assistance, tuition reimbursement, and flexible time off.
If you require accommodation or assistance with the application or onboarding process specifically, please contact
All your information will be kept confidential according to EEO guidelines.
Compensation Range: $87,210 - $137,195 annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. Temporary roles may also qualify for participation in our 401(k) plan after eligibility criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 02/17/2025.
Director, Data Engineering
Posted 9 days ago
Job Viewed
Job Description
A recognized media services firm is actively seeking an experienced professional to join their staff as the new Director, Data Engineering.
*** This is a Hybrid opportunity requiring the qualified professional to work onsite at least 3 days per week .***
Responsibilities:
- Lead high-performing data engineering squads, setting clear objectives, fostering a collaborative environment, and driving team growth.
- Lead the design, development, and maintenance of scalable data pipelines and architectures across internal, third-party, and cloud-based sources
- Ensure data accuracy, completeness, and consistency across various sources
- Collaborate with data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization
- Implement best practices for data engineering, including performance tuning, monitoring, and documentation
- Evaluate and adopt emerging technologies to improve data engineering capabilities
- Foster the growth of your team members through coaching, mentorship, and opportunities for technical development.
- Contribute to strategic planning and execution of data initiatives aligned with business goals
- 6+ years of experience in Data Engineering with at least 2 years of experience in a Leadership role
- Experience with Media-specific Data platforms, including Content Management systems, Ad Tech, and Digital Media Analytics tools
- Proficiency in Programming languages such as Python, Java, or Scala for data processing tasks
- Experience with Cloud platforms (e.g., AWS, Google Cloud, Azure) and Cloud data warehouses (e.g., Redshift, Snowflake, Databricks.)
- Expertise in SQL/ NoSQL databases (e.g., PostgreSQL, MongoDB, BigQuery, or similar), and big data technologies (e.g., Hadoop, Spark, Kafka, etc.)
- Strong background in designing and building complex, high-performance data systems, including data lakes, data warehouses, and real-time data pipelines
- Familiarity with data visualization tools like Tableau or Looker
- Experience with machine learning and data science workflows
- Familiarity with media industry standards and analytics platforms (e.g., Nielsen, comScore, etc.).
- Exposure to agile development practices and project management tools (e.g., Jira, Confluence
- Excellent communication skills to collaborate with other teams and stakeholders
Senior Manager, Data Engineering
Posted 1 day ago
Job Viewed
Job Description
Senior Manager, Data Engineering
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You’ll Do:
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure our code is rigorously designed, elegantly coded, and effectively tuned for performance
Basic Qualifications:
Bachelor’s Degree
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
At least 4 years of people management experience
Preferred Qualifications:
Master's Degree
9+ years of experience in application development including Python, SQL, Scala, or Java
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
4+ year experience working on real-time data and streaming applications
4+ years of experience with NoSQL implementation (Mongo, Cassandra)
4+ years of data warehousing experience (Redshift or Snowflake)
4+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices
6+ years of people management experience
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
Chicago, IL: $204,900 - $33,800 for Sr. Mgr, Data Engineering
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections ; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Be The First To Know
About the latest Etl processes Jobs in New York !
Senior Manager, Data Engineering
Posted 1 day ago
Job Viewed
Job Description
Senior Manager, Data Engineering
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You’ll Do:
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure our code is rigorously designed, elegantly coded, and effectively tuned for performance
Basic Qualifications:
Bachelor’s Degree
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
At least 4 years of people management experience
Preferred Qualifications:
Master's Degree
9+ years of experience in application development including Python, SQL, Scala, or Java
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
4+ year experience working on real-time data and streaming applications
4+ years of experience with NoSQL implementation (Mongo, Cassandra)
4+ years of data warehousing experience (Redshift or Snowflake)
4+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices
6+ years of people management experience
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
Chicago, IL: $204,900 - $33,800 for Sr. Mgr, Data Engineering
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections ; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Data Engineering Manager, Analytics
Posted 2 days ago
Job Viewed
Job Description
Summary:
We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers to support product launches and roadmaps by building the data architecture that informs and drives insight. In this role, there will be a direct link between your work, company growth, and user satisfaction. You'll work with some of the brightest minds in the industry, work with one of the richest data sets in the world, use cutting edge technology, and see your efforts affect products and people on a regular basis.
Required Skills:
Data Engineering Manager, Analytics Responsibilities:
-
Drive the mission and strategy for Business Intelligence (BI) and Data Warehousing across a product vertical
-
Build and lead a high-quality BI and Data Warehousing team, designing it to scale
-
Develop cross-functional relationships with stakeholders to understand data needs and deliver on those needs
-
Manage data warehouse plans, drive data quality, and ensure operational efficiency
-
Design, build, and launch new data models and pipelines in production
-
Deliver high-impact dashboards and data visualizations
-
Define and manage Service Level Agreements (SLAs) for all data sets and processes running in production
-
Drive efficiency and speed, project management leadership, and a vision for how BI can proactively improve companies
Minimum Qualifications:
Minimum Qualifications:
-
A minimum of 4 years of work experience (2+ years with a Ph.D.) in applied analytics, including a minimum of 2 years of experience managing analytics teams
-
8+ years of experience in BI and Data Warehousing
-
Bachelor of Arts/Bachelor of Science in Computer Science, Math, Physics, or other technical fields
-
Experience initiating and completing BI, data warehousing and/or analytical projects with minimal guidance
-
Experience communicating results of analysis to executive leadership
-
Project management experience
-
Data architecture experience
-
Experience with data querying languages (e.g. SQL) and development experience in at least one object-oriented language (Python, Java, etc.)
-
2+ years of experience managing people with experience scaling and managing 3+ person teams
-
Experience working closely on cross-functional teams, including Data Engineering, Data Science, Software Engineering, and Product Management
Preferred Qualifications:
Preferred Qualifications:
-
Experience working closely on cross-functional teams, including Data Engineering, Data Science, Software Engineering, and Product Management
-
Experience with Big Data, Hadoop, and Data visualization tools
-
Advanced degree (e.g.: Master of Science, PhD)
-
Experience working with user facing Products
Public Compensation:
$173,000/year to $242,000/year + bonus + equity + benefits
Industry: Internet
Equal Opportunity:
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at
Director of Data Engineering
Posted 2 days ago
Job Viewed
Job Description
Job Description
The New York City Taxi and Limousine Commission (TLC) is the city agency responsible for regulating for-hire transportation in New York City, including taxis, street hail liveries, high-volume for-hire services such as Uber and Lyft, black cars, luxury limousines, livery vehicles, commuter vans, and paratransit vehicles. The TLC licenses about 177,000 drivers, 115,000 vehicles, and 1,000 businesses, which together transport around a million passengers a day, making TLC the most active for-hire transportation regulatory agency in the world with oversight of a key component of the City's transportation network. With the introduction of new apps and technologies, TLC is on the front lines of a rapidly changing mobility landscape and our innovative efforts--whether regulating driver pay, ensuring wheelchair accessibility, working to eliminate traffic fatalities, or preventing discriminatory service--often serve as a model for other cities.
TLC is looking for a Director of Data Engineering to lead the Data Engineering portfolio within TLC's Data Analytics and Engineering Unit in the Policy Division. TLC receives trip data for every taxi and for-hire vehicle trip in New York City, including information on passenger wait times, GPS coordinates for pickup and drop-off locations, trip times, passenger costs, and driver pay. Because of how many trips are performed daily in TLC-licensed vehicles and how long TLC has been collecting this data, the number of trips to analyze now measures in the billions, allowing TLC's Policy Division to be incredibly data driven.
The Director of Data Engineering will steer the Division's data engineering efforts. This individual should be a self-starter who is ready to be the agency expert on all things data engineering and a creative thinker who is excited to work with big data to drive important policy and data infrastructure decisions. The director will work closely with those in the Data Analytics and Engineering Unit to design and implement data utilizing internal and external data sources; will work with the IT Division to fix potential data collection and storage issues; will present projects to agency leadership, outside stakeholders and the public.
In coordination with the Policy Division leadership, the Director of Data Engineering will:
- Manage and mentor a team of data engineers.
- Have experience with internal data and modernizing of legacy technology systems.
- Research new and understand existing technologies to scale up the team's big data capabilities.
- Lead the design of our team's data infrastructure, ensuring the data engineering team can support the division's data work.
- Ideate and write scripts to transform our big and complex data into aggregate and cleaner data that can then be used to analyze and display information for the purpose of policymaking and policy evaluation.
- Plan short and long-term visions for the data engineering team and outline team members' projects.
- Design, test and deploy data storage, data pipelines, and monitoring systems.
To Apply:
Please go to cityjobs.nyc.gov and search for Job ID# or click the "Apply" button below.
SUBMISSION OF A RESUME IS NOT A GUARANTEE THAT YOU WILL RECEIVE AN INTERVIEW.
APPOINTMENTS ARE SUBJECT TO OVERSIGHT APPROVAL.
CITY RESEARCH SCIENTIST - 21744
Qualifications
1. For Assignment Level I (only physical, biological and environmental sciences and public health) A master's degree from an accredited college or university with a specialization in an appropriate field of physical, biological or environmental science or in public health.
To be appointed to Assignment Level II and above, candidates must have:
1. A doctorate degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and one year of full-time experience in a responsible supervisory, administrative or research capacity in the appropriate field of specialization; or
2. A master's degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and three years of responsible full-time research experience in the appropriate field of specialization; or
3. Education and/or experience which is equivalent to "1" or "2" above. However, all candidates must have at least a master's degree in an appropriate field of specialization and at least two years of experience described in "2" above. Two years as a City Research Scientist Level I can be substituted for the experience required in "1" and "2" above.
NOTE:
Probationary Period
Appointments to this position are subject to a minimum probationary period of one year.
Additional Information
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.