36 Apache Kafka jobs in the United States

ETL Tester - Apache Kafka

75215 Park Cities, Texas Diverse Lynx

Posted 10 days ago

Job Viewed

Tap Again To Close

Job Description

Role Description:
  • Data Pipeline Testing Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.
  • Data Validation Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
  • Kafka Expertise Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafkas architecture and concepts.
  • Scripting and Automation Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
  • Issue Resolution Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions.
  • Performance Testing Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.
  • AgileScrum Understanding and working within AgileScrum methodologies and participating in testing activities within the development lifecycle.
  • Data Warehousing Familiarity with data warehousing concepts and cloud data platforms is often a plus.
Essential Skills:
  • Apache Kafka Deep understanding of Kafkas architecture, components, and functionality.
  • SQL Experience with SQL for data validation and debugging.
  • ETL Experience with ETL processes and data warehousing concepts.
  • Test Automation Experience in developing and maintaining automated tests for data pipelines.
  • Data Analysis Ability to analyze data, identify issues, and propose solutions.
  • Communication Strong communication and collaboration skills are essential for working with development teams.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
View Now

Senior Apache Kafka Engineer - Contractor

60290 Chicago, Illinois Lemongrass Consulting Inc

Posted 24 days ago

Job Viewed

Tap Again To Close

Job Description

Vacancy Name
Senior Apache Kafka Engineer - Contractor

Vacancy No
VN1247

Business Unit
Americas

Job Location
Chicago, USA

Employment Type
Full Time

Job Details and Responsibilities

We are seeking a highly skilled Senior Apache Kafka Engineer to lead the design, development, and operation of our enterprise-wide event streaming platform. This role requires deep expertise in Kafka as well as strong system analysis and design skills. The ideal candidate will have prior experience taking ownership of a complex, production-grade Kafka deployment and improving its scalability, resilience, and performance.

Key Responsibilities
  • Take full ownership of an existing, business-critical Kafka implementation: assess, stabilize, and evolve the architecture.
  • Conduct comprehensive system analysis and design for event-driven and streaming data architectures.
  • Design, build, and manage Kafka clusters across multiple environments (dev, staging, prod).
  • Collaborate with engineering, product, and architecture teams to define and implement scalable streaming solutions.
  • Design and optimize topic structures, partitioning strategies, and schema evolution approaches (e.g., using Avro).
  • Build and maintain Kafka Connect pipelines and integration with external data sources and sinks.
  • Ensure platform observability, reliability, security, and compliance with enterprise standards.
  • Diagnose and resolve issues related to message delivery, latency, consumer lag, and broker performance.
  • Contribute to documentation, operational runbooks, and internal training initiatives.
  • Lead incident resolution, root cause analysis, and continuous improvement for Kafka infrastructure.
Qualifications

Required Qualifications
  • 5+ years of experience in software engineering or data platform roles, with 3+ years working directly with Apache Kafka in production.
  • Demonstrated experience taking ownership of complex, large-scale Kafka environments.
  • Strong system analysis and design capabilities, particularly in the context of distributed data systems.
  • Deep understanding of Kafka architecture (brokers, partitions, replication, KRaft/ZooKeeper, ISR, etc.).
  • Proficient in building Kafka-based data pipelines and real-time applications using Kafka Streams, ksqlDB, or similar tools.
  • Programming expertise in Java, Scala, or Python.
  • Familiarity with Kafka Connect, Schema Registry, and integrations with data systems like databases, Elasticsearch, cloud storage, and more.
  • Hands-on experience with containerized platforms (Docker, Kubernetes) and infrastructure automation (Terraform, Helm).
  • Experience managing Kafka in cloud environments (AWS MSK, Confluent Cloud, Azure Event Hubs, or self-managed).
  • Knowledge of monitoring tools and alerting (Prometheus, Grafana, Control Center, Datadog, etc.).
Preferred Qualifications
  • Confluent Certified Kafka Developer or Administrator.
  • Experience leading Kafka modernization or re-architecture efforts.
  • Background in data governance, event modeling, and schema versioning strategies.
  • Familiarity with microservices architecture and event-driven design best practices.
Soft Skills
  • Strong analytical thinking and problem-solving skills.
  • Ability to communicate effectively with both technical and non-technical stakeholders.
  • Ownership mindset and comfort navigating ambiguity in complex systems.
  • Team leadership or mentoring experience is a plus.
What We Offer
  • Competitive compensation and performance-based incentives.
  • Flexible work environment and remote options.
  • Access to training, certifications, and cutting-edge tools.
  • Comprehensive benefits (medical, dental, vision, PTO, retirement).

Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.

Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

About Lemongrass

Lemongrass (lemongrasscloud.com) is a global leader in SAP consulting, focused on helping organizations transform their business processes through innovative solutions and technologies. With a strong commitment to customer success, Lemongrass partners with companies to drive their digital transformation journeys, enabling them to unlock the full potential of their SAP investments.

We do this with our continuous innovation, automation, migration and operation, delivered on the world's most comprehensive cloud platforms - AWS, Azure and GCP and SAP Cloud ERP. We have been working with AWS and SAP since 2010 and we are a Premier Amazon Partner Network (APN) Consulting Partner. We are also a Microsoft Gold Partner, a Google Cloud Partner and an SAP Certified Silver Partner.

Our team is what makes Lemongrass exceptional and why we have the excellent reputation in the market that we enjoy today. At Lemongrass, you will work with the smartest and most motivated people in the business. We take pride in our culture of innovation and collaboration that drives us to deliver exceptional benefits to our clients every day.
View Now

Junior Big Data Engineer (Apache Spark, Kafka)

98009 North Bend, Washington SynergisticIT

Posted 14 days ago

Job Viewed

Tap Again To Close

Job Description

For more than 15 years Synergisticit has helped Jobseekers get employed in the tech Job market by providing candidates the requisite skills, experience and technical competence to outperform at interviews and at clients. Here at SynergisticIT We just don't focus on getting you a tech Job we make careers.
In this Job market also, our candidates are able to achieve multiple job offers and $100k + salaries.

please check the below links :








Why do Tech Companies not Hire recent Computer Science Graduates | SynergisticIT

Technical Skills or Experience? | Which one is important to get a Job? | SynergisticIT

All Positions are open for all visas and US citizens
We at Synergisticit understand the problem of the mismatch between employer's requirements and Employee skills and that's why since 2010 we have helped 1000's of candidates get jobs at technology clients like apple, google, Paypal, western union, Client, visa, walmart lab s etc to name a few.
Currently, We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/Data Engineers/ Data Scientists, Machine Learning engineers for full time positions with clients.
Who Should Apply Recent Computer science/Engineering /Mathematics/Statistics or Science Graduates or People looking to switch careers or who have had gaps in employment and looking to make their careers in the Tech Industry.
We assist in filing for STEM extension and also for H1b and Green card filing to Candidates
We want Data Science/Machine learning/Data Analyst and Java Full stack candidates
For data Science/Machine learning Positions
REQUIRED SKILLS
Bachelors degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, IT
Project work on the technologies needed
Highly motivated, self-learner, and technically inquisitive
Experience in programming language Java and understanding of the software development life cycle
Knowledge of Statistics, Gen AI, LLM, Python, Computer Vision, data visualization tools
Excellent written and verbal communication skills
Preferred skills: Snowflake, Databricks, Text mining, Tableau, PowerBI, Databricks, Tensorflow
REQUIRED SKILLS For Java /Full stack/Software Positions
Bachelors degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, IT
Highly motivated, self-learner, and technically inquisitive
Experience in programming language Java and understanding of the software development life cycle
Project work on the skills
Knowledge of Core Java , javascript , C++ or software programming
Spring boot, AWS, Microservices, Docker, Jenkins, Github, Kubernates and REST API's experience
Excellent written and verbal communication skills
If you get emails from our Job Placement team and are not interested please email them or ask them to take you off their distribution list and make you unavailable as they share the same database with the client servicing team who only connect with candidates who are matching client requirements.
No phone calls please. Shortlisted candidates would be reached out. No third party or agency candidates or c2c candidates
View Now

Junior Big Data Engineer (Apache Spark, Kafka)

23500 Norfolk, Virginia SynergisticIT

Posted 22 days ago

Job Viewed

Tap Again To Close

Job Description

For 15 years SynergisticIT has helped Jobseekers get employed in the tech Job market by providing candidates the requisite skills, experience and technical competence to outperform at interviews and at clients.
Please see the below links to know more about Synergisticit and some useful tips







Why do Tech Companies not Hire recent Computer Science Graduates | SynergisticIT

Technical Skills or Experience? | Which one is important to get a Job? | SynergisticIT

We regularly interact with the Top Tech companies to give our candidates a competitive advantage.
We at Synergisticit understand the problem of the mismatch between employer's requirements and Employee skills and that's why since 2010 we have helped 1000's of candidates get jobs at technology clients like apple, google, Paypal, western union, Client, visa, walmart lab s etc to name a few.
We are continuously looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Data Engineers, Machine Learning engineers for full time positions with clients.
Who Should Apply? Recent Computer science/Engineering /Mathematics/Statistics or Science Graduates or People looking to switch careers or who have had gaps in employment and looking to make their careers in the Tech Industry.
We need Data Science/Data Engineers /Data Analyst and Java Full stack candidates
Preferred SKILLS For Java /Full stack/Devops Positions
Bachelors degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, IT
Knowledge of Core Java , javascript , C++ or software programming
Spring boot, Microservices, Docker, Jenkins, Github, Kubernates and REST API's experience
For data Science/Data Analyst/Data Engineer/AI/Machine learning Positions
Preferred SKILLS
Associate or Bachelors degree or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, IT, Statistics, Mathematics or having good logical aptitude
Knowledge of Statistics, Snowflake, Gen AI, LLM, Sagemaker, Python, Computer Vision, data visualization tools
Candidates lacking technical skills can research our other programs which can assist in landing a Job
If you get emails from our Job Placement team and are not interested please email them or ask them to take you off their distribution list and make you unavailable as they share the same database with the client servicing team who only connect with candidates who are matching client requirements.
No phone calls please. Shortlisted candidates would be reached out. No third party or agency candidates or c2c candidates
View Now

Software Engineer - Data Streaming

94061 Redwood City, California TigerGraph

Posted 10 days ago

Job Viewed

Tap Again To Close

Job Description

TigerGraph is a platform for advanced analytics and machine learning on connected data. TigerGraph's core technology is the only scalable graph database for the enterprise. Its proven technology supports fraud detection, customer 360, MDM, IoT, AI, and machine learning.

Fortune 500 organizations and the most innovative mid-size and startup companies choose TigerGraph to accelerate their analytics, AI, and machine learning:

  • Seven out of the top ten global banks use TigerGraph for real-time fraud detection.
  • Over 50 million patients receive care path recommendations to assist them on their wellness journey.
  • 300 million consumers receive personalized offers with recommendation engines powered by TigerGraph.
  • TigerGraph reduces power outages by optimizing the energy infrastructure for 1 billion people.
This position is primarily remote, but location-based requirements may apply. If the selected candidate is located near one of our company offices, the candidate will have a hybrid work arrangement (2-3 days in-office).
Job Responsibilities
  • Contribute to building a distributed and reliable framework for streaming data from various sources into TigerGraph's graph database.
  • Develop efficient data pipelines for ingesting and pre-processing structured and semi-structured data.
  • Build lightweight tools and services to monitor and visualize data ingestion and processing flows.
  • Stay informed about evolving trends in data science and apply them to streaming infrastructure and architecture.
Requirements
  • Bachelor's degree in Computer Science or a related field; 1-3 years of relevant experience preferred.
Skills and Knowledge
  • Solid programming fundamentals; experienced with Java, Go, or any other major programming language.
  • Understanding of distributed systems principles and the ability to evaluate trade-offs in system design.
  • Familiar with Kafka or similar streaming technologies; knowledge of Kafka Connect, Flink, or Spark Streaming is a plus.
  • Capable of identifying and addressing performance bottlenecks related to serialization, buffering, and data flow in streaming systems.
  • Proficient with Linux command-line tools and shell scripting for effective debugging and development workflows.
  • Proactive and collaborative team player with strong communication skills.
  • Open to adopting AI-assisted engineering practices ("vibe coding") to improve productivity and code quality.
Bonus Points
  • Experience with data lakehouse technologies such as Apache Iceberg, Delta Lake, or Hudi.
  • Familiar with container tools such as Docker.
  • Experience with Kubernetes or basic cloud-native development concepts.
  • Interest in distributed coordination systems like Zookeeper, ETCD, or Consul.
  • Hands-on experience with gRPC or REST APIs.
  • Passionate about systems performance profiling, tuning, or debugging.

The anticipated salary range for candidates who will work in Redwood City, CA is $130,000 - $160,000. The final salary offered to a successful candidate will be dependent on several factors that may include, but are not limited to, the type and length of experience within the job, type and length of experience within the industry, education, etc. TigerGraph is a multi-state employer and this salary range may not reflect positions that work in other states.
View Now

Principal Software Engineer, Data Streaming (PST)

94199 San Francisco, California Autodesk

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

Job Requisition ID #

25WD85185

Position Overview

At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.

We're looking for a Principal Software Engineer to help design and develop a large-scale stream processing platform that enables near-real-time data ingestion and processing. If you thrive in a collaborative, inclusive, and problem-solving environment, we'd love to meet you!

Responsibilities

  • Develop Scalable Solutions - Write secure, stable, and high-quality code that powers Autodesk's next-generation data platform

  • Architect for Impact - Design and build highly available, efficient, and scalable data processing solutions used across multiple teams

  • Foster Collaboration - Work closely with engineers, architects, and product managers to translate ideas into practical, well-designed software components

  • Champion Technical Excellence - Apply best practices in software design, test-driven development, and continuous integration

  • Mentor and Empower - Share your expertise by guiding and supporting engineers at all experience levels

  • Solve Complex Challenges - Build and optimize data pipelines, self-healing systems, and real-time processing architectures

  • Ensure Performance & Reliability - Define performance benchmarks, conduct rigorous testing, and continuously improve efficiency

Minimum Qualifications

  • 8+ years of experience in software engineering, including 2+ years in Data Engineering

  • Deep expertise in streaming technologies (Kafka, Flink, AWS Kinesis Firehose)

  • Strong programming skills in Java or Python, with a focus on performance and scalability

  • Proven experience with cloud architectures (AWS preferred)

  • Hands-on experience building highly available, distributed systems & microservices

  • Experience with CI/CD tools (e.g., Jenkins, GitHub, Artifactory) and container frameworks (Docker, Kubernetes)

  • Strong analytical and problem-solving skills, with a growth mindset

  • Ability to communicate effectively and work collaboratively across teams

Preferred Qualifications

  • Familiarity with RESTful web services and microservices

  • Knowledge of Data Lakes, Warehouses, and ETL pipelines

  • Experience implementing QA frameworks and system monitoring

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk - it's at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When you're an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

Salary transparency

Salary is one part of Autodesk's competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here:

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

View Now

Principal Software Engineer, Data Streaming (PST)

94103, California Autodesk

Posted today

Job Viewed

Tap Again To Close

Job Description

**Job Requisition ID #**
25WD85185
**Position Overview**
At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.
We're looking for a Principal Software Engineer to help design and develop a large-scale stream processing platform that enables near-real-time data ingestion and processing. If you thrive in a collaborative, inclusive, and problem-solving environment, we'd love to meet you!
**Responsibilities**
+ Develop Scalable Solutions - Write secure, stable, and high-quality code that powers Autodesk's next-generation data platform
+ Architect for Impact - Design and build highly available, efficient, and scalable data processing solutions used across multiple teams
+ Foster Collaboration - Work closely with engineers, architects, and product managers to translate ideas into practical, well-designed software components
+ Champion Technical Excellence - Apply best practices in software design, test-driven development, and continuous integration
+ Mentor and Empower - Share your expertise by guiding and supporting engineers at all experience levels
+ Solve Complex Challenges - Build and optimize data pipelines, self-healing systems, and real-time processing architectures
+ Ensure Performance & Reliability - Define performance benchmarks, conduct rigorous testing, and continuously improve efficiency
**Minimum Qualifications**
+ **8+ years of experience in software engineering, including 2+ years in Data Engineering**
+ **Deep expertise in streaming technologies (Kafka, Flink, AWS Kinesis Firehose)**
+ Strong programming skills in Java or Python, with a focus on performance and scalability
+ Proven experience with cloud architectures (AWS preferred)
+ Hands-on experience building highly available, distributed systems & microservices
+ Experience with CI/CD tools (e.g., Jenkins, GitHub, Artifactory) and container frameworks (Docker, Kubernetes)
+ Strong analytical and problem-solving skills, with a growth mindset
+ Ability to communicate effectively and work collaboratively across teams
**Preferred Qualifications**
+ Familiarity with RESTful web services and microservices
+ Knowledge of Data Lakes, Warehouses, and ETL pipelines
+ Experience implementing QA frameworks and system monitoring
**Learn More**
**About Autodesk**
Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk - it's at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you're an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
**Benefits**
From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting transparency**
Salary is one part of Autodesk's competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
**Equal Employment Opportunity**
At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.
**Diversity & Belonging**
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: you an existing contractor or consultant with Autodesk?**
Please search for open jobs and apply internally (not on this external site).
View Now
Be The First To Know

About the latest Apache kafka Jobs in United States !

Principal Software Engineer, Data Streaming (San Francisco)

94110 San Francisco, California Autodesk, Inc.

Posted 12 days ago

Job Viewed

Tap Again To Close

Job Description

full time
Principal Software Engineer, Data Platform, West Coast United States

Apply locations San Francisco, CA, USA time type Full time posted on Posted 2 Days Ago job requisition id 25WD85185

Job Requisition ID # 25WD85185

Position Overview

At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.

Were looking for a Principal Software Engineer to help design and develop a large-scale stream processing platform that enables near-real-time data ingestion and processing. If you thrive in a collaborative, inclusive, and problem-solving environment, wed love to meet you!

Responsibilities

  • Develop Scalable Solutions Write secure, stable, and high-quality code that powers Autodesks next-generation data platform
  • Architect for Impact Design and build highly available, efficient, and scalable data processing solutions used across multiple teams
  • Foster Collaboration Work closely with engineers, architects, and product managers to translate ideas into practical, well-designed software components
  • Champion Technical Excellence Apply best practices in software design, test-driven development, and continuous integration
  • Mentor and Empower Share your expertise by guiding and supporting engineers at all experience levels
  • Solve Complex Challenges Build and optimize data pipelines, self-healing systems, and real-time processing architectures
  • Ensure Performance & Reliability Define performance benchmarks, conduct rigorous testing, and continuously improve efficiency

Minimum Qualifications

  • 8+ years of experience in software engineering, including 2+ years in Data Engineering
  • Deep expertise in streaming technologies (Kafka, Flink, AWS Kinesis Firehose)
  • Strong programming skills in Java or Python, with a focus on performance and scalability
  • Proven experience with cloud architectures (AWS preferred)
  • Hands-on experience building highly available, distributed systems & microservices
  • Experience with CI/CD tools (e.g., Jenkins, GitHub, Artifactory) and container frameworks (Docker, Kubernetes)
  • Strong analytical and problem-solving skills, with a growth mindset
  • Ability to communicate effectively and work collaboratively across teams

Preferred Qualifications

  • Familiarity with RESTful web services and microservices
  • Knowledge of Data Lakes, Warehouses, and ETL pipelines
  • Experience implementing QA frameworks and system monitoring

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When youre an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

Salary transparency

Salary is one part of Autodesks competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidates experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here:

#J-18808-Ljbffr
View Now

Principal Software Engineer, Data Streaming (PST) (San Francisco)

94121 San Francisco, California Autodesk

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

full time
Principal Software Engineer, Data Streaming

Join to apply for the Principal Software Engineer, Data Streaming role at Autodesk

Principal Software Engineer, Data Streaming

Join to apply for the Principal Software Engineer, Data Streaming role at Autodesk

Get AI-powered advice on this job and more exclusive features.

Position Overview

At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.

Job Requisition ID #

25WD85185

Position Overview

At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.

Were looking for a Principal Software Engineer to help design and develop a large-scale stream processing platform that enables near-real-time data ingestion and processing. If you thrive in a collaborative, inclusive, and problem-solving environment, wed love to meet you!

Responsibilities

  • Develop Scalable Solutions Write secure, stable, and high-quality code that powers Autodesks next-generation data platform
  • Architect for Impact Design and build highly available, efficient, and scalable data processing solutions used across multiple teams
  • Foster Collaboration Work closely with engineers, architects, and product managers to translate ideas into practical, well-designed software components
  • Champion Technical Excellence Apply best practices in software design, test-driven development, and continuous integration
  • Mentor and Empower Share your expertise by guiding and supporting engineers at all experience levels
  • Solve Complex Challenges Build and optimize data pipelines, self-healing systems, and real-time processing architectures
  • Ensure Performance & Reliability Define performance benchmarks, conduct rigorous testing, and continuously improve efficiency

Minimum Qualifications

  • 8+ years of experience in software engineering, including 2+ years in Data Engineering
  • Deep expertise in streaming technologies (Kafka, Flink, AWS Kinesis Firehose)
  • Strong programming skills in Java or Python, with a focus on performance and scalability
  • Proven experience with cloud architectures (AWS preferred)
  • Hands-on experience building highly available, distributed systems & microservices
  • Experience with CI/CD tools (e.g., Jenkins, GitHub, Artifactory) and container frameworks (Docker, Kubernetes)
  • Strong analytical and problem-solving skills, with a growth mindset
  • Ability to communicate effectively and work collaboratively across teams

Preferred Qualifications

  • Familiarity with RESTful web services and microservices
  • Knowledge of Data Lakes, Warehouses, and ETL pipelines
  • Experience implementing QA frameworks and system monitoring

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When youre an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting transparency

Salary is one part of Autodesks competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $28,800. Offers are based on the candidates experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Full-time
Job function
  • Job function Engineering and Information Technology
  • Industries Software Development, Design Services, and IT Services and IT Consulting

Referrals increase your chances of interviewing at Autodesk by 2x

Get notified about new Principal Software Engineer jobs in San Francisco, CA .

Senior Manager, Software Engineering - Slack AI Software Engineering Manager, Members Experience Director/Senior Director, Machine Learning and Engineering

San Francisco, CA 223,000 - 248,000 3 days ago

Technical Lead/ Manager, Software Engineering

Hayward, CA 170,000 - 190,000 1 month ago

San Francisco, CA
223,000.00
-
248,000.00
3 days ago

Software Engineering Manager, Developer Tools

San Mateo, CA
195,500.00
-
293,300.00
4 days ago

Software Engineering Manager, Infrastructure

San Francisco, CA
177,000.00
-
251,000.00
3 days ago

Software Engineering Manager, Infrastructure Senior Software Engineer, Handshake Plus - Monetization

San Francisco, CA
180,000.00
-
220,000.00
2 days ago

San Francisco, CA
132,700.00
-
267,600.00
5 days ago

San Francisco, CA
204,000.00
-
259,000.00
2 weeks ago

San Mateo, CA
200,000.00
-
315,000.00
1 week ago

Software Engineering Manager II, Front End, Google Cloud

San Francisco, CA
197,000.00
-
291,000.00
5 hours ago

San Mateo, CA
200,000.00
-
350,000.00
1 week ago

Manager/Sr. Manager - Software Engineering

San Francisco, CA
157,600.00
-
384,100.00
1 day ago

Senior Manager, Software Engineering - Slack AI

San Francisco, CA
200,800.00
-
276,100.00
3 days ago

Senior Manager, Software Engineering, Evaluators, Education

Redwood City, CA
241,000.00
-
362,000.00
2 weeks ago

Manager, Software Engineering (Integrations Platform) Principal Software Engineer - Computational Chemistry / Molecular Dynamics

San Francisco, CA 200,000 - 405,000 3 weeks ago

San Francisco, CA 177,000 - 251,000 3 days ago

Software Engineering Manager - Wearables AI

San Francisco, CA 172,800 - 297,000 2 weeks ago

Senior / Staff Software Engineer - Computational Chemistry / Molecular Dynamics

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
View Now

Principal Software Engineer, Data Streaming (PST) (San Francisco)

94110 San Francisco, California Autodesk

Posted 12 days ago

Job Viewed

Tap Again To Close

Job Description

full time

Job Requisition ID #

25WD85185

Position Overview

At Autodesk, we believe in the power of data-driven innovation to shape the world. If you're passionate about building scalable, high-performance platforms that empower millions of users worldwide, we invite you to join our Analytics Data Platform team.

Were looking for a Principal Software Engineer to help design and develop a large-scale stream processing platform that enables near-real-time data ingestion and processing. If you thrive in a collaborative, inclusive, and problem-solving environment, wed love to meet you!

Responsibilities

  • Develop Scalable Solutions Write secure, stable, and high-quality code that powers Autodesks next-generation data platform

  • Architect for Impact Design and build highly available, efficient, and scalable data processing solutions used across multiple teams

  • Foster Collaboration Work closely with engineers, architects, and product managers to translate ideas into practical, well-designed software components

  • Champion Technical Excellence Apply best practices in software design, test-driven development, and continuous integration

  • Mentor and Empower Share your expertise by guiding and supporting engineers at all experience levels

  • Solve Complex Challenges Build and optimize data pipelines, self-healing systems, and real-time processing architectures

  • Ensure Performance & Reliability Define performance benchmarks, conduct rigorous testing, and continuously improve efficiency

Minimum Qualifications

  • 8+ years of experience in software engineering, including 2+ years in Data Engineering

  • Deep expertise in streaming technologies (Kafka, Flink, AWS Kinesis Firehose)

  • Strong programming skills in Java or Python, with a focus on performance and scalability

  • Proven experience with cloud architectures (AWS preferred)

  • Hands-on experience building highly available, distributed systems & microservices

  • Experience with CI/CD tools (e.g., Jenkins, GitHub, Artifactory) and container frameworks (Docker, Kubernetes)

  • Strong analytical and problem-solving skills, with a growth mindset

  • Ability to communicate effectively and work collaboratively across teams

Preferred Qualifications

  • Familiarity with RESTful web services and microservices

  • Knowledge of Data Lakes, Warehouses, and ETL pipelines

  • Experience implementing QA frameworks and system monitoring

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk its at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When youre an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

Salary transparency

Salary is one part of Autodesks competitive compensation package. For U.S.-based roles, we expect a starting base salary between $141,400 and $228,800. Offers are based on the candidates experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Diversity & Belonging

We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here:

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

#J-18808-Ljbffr
View Now
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Apache Kafka Jobs