19,982 AI Software Engineer jobs in the United States

Description

1. Home
2. Search Jobs
3. Job Description

• Design and implement end-to-end AI agent solutions using Copilot 365, Copilot Studio and agent-tech frameworks
• Develop and maintain backend services in Java (Spring Boot, Micronaut or similar) and microservices architectures
• Integrate with cloud platforms (Azure preferred) to host AI models, data pipelines and containerized services (Kubernetes, Docker)
• Collaborate with data scientists to productionize ML/LLM models, handling model fine-tuning, prompt engineering, RAG and embedding stores
• Build secure, scalable RESTful APIs and event-driven workflows to support conversational and autonomous agent scenarios

• Hands-on experience building AI/ML solutions: LLM integration, prompt engineering, embeddings and RAG
• Development experience with Java and microservices
• Proficiency with MS 365 Copilot, Copilot Studio or equivalent agent-tech platforms
• Strong knowledge of Azure AI services (Azure OpenAI, Cognitive Services), Kubernetes, Docker

• Design and implement end-to-end AI agent solutions
• Hands-on experience building AI/ML solutions
• Development experience with Java and microservices
• Build secure
• scalable RESTful APIs

• Recruiter
• Email
• Phone
• Aditi Shrivastava

Thanks for your interest in Success Academy! Running the largest, fastest-growing, and highest-performing network of public charter schools in New York City takes a village - families, children, teachers, staff and faculty, advocates, and supporters alike. We would love to welcome you to our community! We work tirelessly every day to ensure each child in NYC has access to a fun, rigorous, whole-child education regardless of zip code or economic status. When you join SA, you play a part in giving every student who walks through the doors of one of our 57 schools in NYC a fair shot at reaching his or her potential.

As the fastest growing, highest-performing charter school network in New York State, Success Academy is reimagining K-12 public education. Nationally recognized for our innovative, whole-child school model and outstanding academic results, Success Academy educators are empowering children from all backgrounds with the knowledge, skills, and self-belief to succeed in college and in life. We now need a results-driven AI Software Engineer / Integration Specialist to join our AI Enablement team.

The Technology Division at Success Academy is the chief provider of technology infrastructure, application services, security, and support. The Division partners with teams across the organization to equip students, teachers, leaders, and staff with the innovative technology tools and know-how necessary to achieve academic and operational excellence.

We are looking for an AI Software Engineer to play a critical role in connecting AI tools with school systems. This role ensures that AI-powered solutions seamlessly integrate with existing School Information Systems (SIS), Learning Management Systems (LMS), and other educational technologies.

The ideal candidate has a strong background in software integration, API development, automation, and cloud-based solutions. They should be comfortable working with education technology platforms while designing scalable, automated workflows to enhance school operations using AI.

Requirements :

• 4+ years of experience in software integration, API development, or automation engineering.

• Experience working with SIS, LMS, and education technology platforms.

• Strong proficiency in API development, automation workflows, and event-driven architectures.

• Knowledge of cloud-native integration tools in AWS, GCP, or Azure.

• Excellent problem-solving skills and an automation-first mindset.

• Strong ability to collaborate with AI, cloud, and data engineering teams to create scalable AI-driven solutions.

• Familiarity with LLMs and AI-powered automation is a plus.

Responsibilities :

• Design and implement integrations between AI models and school systems (SIS, LMS, student data platforms, and assessment tools).

• Work with common SIS & LMS platforms such as PowerSchool, Infinite Campus, Blackbaud, Canvas, Moodle, Google Classroom, and Microsoft Teams for Education.

• Develop middleware, APIs, and automation scripts to enable AI-enhanced workflows for grading, student engagement analysis, and predictive insights.

• Build, deploy, and manage RESTful APIs, GraphQL APIs, and Webhooks to enable seamless communication between AI and school infrastructure.

• Automate data extraction, transformation, and synchronization between systems using ETL pipelines and API-driven workflows.

• Develop integrations with LLM-based AI assistants, chatbots, and recommendation engines to enhance learning experiences.

• Leverage low-code and no-code automation tools where applicable for rapid deployment of solutions.

• Ensure real-time data flow between AI tools and student management systems using Pub/Sub, Kafka, or event-driven architectures.

• Implement secure authentication and authorization protocols (OAuth 2.0, SAML, JWT) to protect student and faculty data.

• Ensure compliance with FERPA and other education data privacy regulations.

• Work with identity and access management (IAM) solutions to control AI system permissions.

• Work closely with AI teams, data engineers, and DevOps to deploy integrations in AWS and GCP.

• Develop serverless functions (AWS Lambda, Google Cloud Functions, Azure Functions) for lightweight, scalable automation.

• Implement event-driven architectures using Step Functions, Pub/Sub, and Webhooks.

• Collaborate with educators and administrators to define integration requirements and automation opportunities.

Technical Stack & Tools

Integration & API Development:

• RESTful APIs, GraphQL, gRPC

• OAuth 2.0, JWT, SAML, OpenID Connect

• Postman, Swagger (OpenAPI), API Gateway

Cloud & Infrastructure:

• AWS (Lambda, Step Functions, API Gateway, EventBridge, S3, DynamoDB)

• GCP (Cloud Functions, Pub/Sub, Firestore, BigQuery)

• Azure (Azure Functions, Event Grid, Cosmos DB)

Automation & Data Pipelines:

• Python, Node.js, FastAPI, Flask, Express.js

• ETL tools (Talend, dbt)

• Messaging & Streaming: Kafka, RabbitMQ, Redis Pub/Sub

Security & Compliance:

• IAM & Role-Based Access Control (RBAC)

• Data encryption, secure API access

• Compliance with FERPA

To join our team, please upload a cover letter and resume that outlines your candidacy. Your cover letter should explain in detail your qualifications for the position. Resumes without cover letters will not be reviewed.

Success Academy Charter Schools is an equal opportunity employer and actively encourages applications from people of all backgrounds. Compensation is competitive and commensurate with experience. Success Academy offers a full benefits program and opportunities for professional growth.

Exact compensation may vary based on skills and experience.

Compensation Range

$160,000 - $180,000 USD

Success Academy Charter Schools is an equal opportunity employer and actively encourages applications from people of all backgrounds. Compensation is competitive and commensurate with experience. Success Academy offers a full benefits program and opportunities for professional growth.

Privacy Policy:

By providing your phone number, you consent to receive text message updates from Success Academy regarding your application. Reply STOP to unsubscribe. View our Privacy Policy .

Current Success Academies Employees:

Please apply through the Internal Job Board via Greenhouse.

You will be asked to log in through your Okta Profile.

We are an equal opportunity employer and value diversity at our organization. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We actively seek applications from people of all backgrounds to strengthen our community and the perspectives needed to flourish in a multicultural world. Success Academy offers a full benefits program and opportunities for professional growth. Learn more about our philosophy, benefits, and team at our Working Here page.

Success Academy Charter Schools does not offer employment-based immigration sponsorship.

• A quick learner.
  
• A positive, self-motivated, and passionate person.
  
• Independent, insistent, and open-minded.
  

• Pursuing a Master's or PhD's degree in Computer Science, Artificial Intelligence, Machine Learning or a related field
  
• Proficiency in AI/ML, Deep Learning, LLM, RAG
  
• Knowledge in one or more Open-Source AI Agent Frameworks: LangChain/LangGraph, AutoGen, CrewAI, etc.
  
• Proficiency in Python development is essential
  
• Knowledge in Git, Jenkins
  

At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.

As the nation's leading health solutions company, we reach millions of Americans through our local presence, digital channels and more than 300,000 purpose-driven colleagues - caring for people where, when and how they choose in a way that is uniquely more connected, more convenient and more compassionate. And we do it all with heart, each and every day.

Position Summary:

CVS Health is seeking a hands-on, passionate, and forward-thinking Software Development Engineer to join a dynamic and rapidly evolving team at the forefront of digital health innovation. This role is ideal for individuals who are excited about building AI-driven capabilities and leveraging emerging technologies such as generative AI, agentic AI, and intelligent automation to transform the future of healthcare.

As part of the Aetna Technology organization, you will contribute to the design and development of next-generation platforms and intelligent systems that power our suite of clinical and interoperability products. Your work will directly support the creation of AI-enabled solutions that enhance patient outcomes, streamline healthcare delivery, and personalize the customer experience.

In this role, you will:

• Lead the development of scalable software systems that integrate generative AI models, autonomous agents, and machine learning pipelines

• Collaborate with cross-functional teams to identify opportunities for AI-first innovation across digital health products

• Drive the adoption of AI engineering best practices, including prompt engineering, model fine-tuning, and responsible AI governance

• Facilitate technical discussions between Application Architects and developers to ensure AI capabilities are embedded into the design and architecture of new solutions

• Stay current with advancements in AI and emerging technologies, and translate them into actionable strategies for product development

This is a unique opportunity to shape the future of healthcare by building intelligent systems that empower people to live healthier lives.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and APIs using Python and FastAPI.

• Integrate and orchestrate LangChain and LLM-based services into production environments.

• Build robust data preprocessing workflows for structured and unstructured data.

• Develop and maintain integrations with external and internal RESTful services.

• Collaborate with ML engineers, data scientists, and product teams to deliver end-to-end AI solutions.

• Implement DevOps best practices including CI/CD pipelines, containerization (Docker)

• Identify and resolve security vulnerabilities in data services and APIs.

• Monitor and optimize system performance, reliability, and scalability.

Required Qualifications:

• 5+ years of experience in software/data engineering with a focus on backend development

• Strong proficiency in Python and experience with FastAPI for building APIs

• Hands-on experience with LangChain, LLMs (e.g., OpenAI, Vertex AI, Hugging Face Transformers), and vector databases

• Solid understanding of REST API design and integration

• Experience with data preprocessing, ETL/ELT pipelines, and working with large datasets

• Familiarity with DevOps tools such as Docker, Kubernetes, GitHub Actions, Jenkins, etc

• 3+ years Experience with cloud platforms (AWS, GCP, or Azure)

• Strong understanding of application security, including authentication, authorization, and vulnerability mitigation

• 3+ years coding in Python/PySpark, Java Springboot, NoSQL, SQL, and LLM modeling

Preferred Qualifications:

• Experience with streaming data frameworks (e.g., Kafka, Spark Streaming)

• Familiarity with data governance and compliance standards (e.g., PHI, PII, HIPAA)

• Contributions to open-source projects in the AI/ML or data engineering space

• Experience with Prompt Engineering developing solutions leveraging LLM models

• 3+ years coding in Python/PySpark, SQL, and LLM modeling

• 3+ years in cloud-based platforms such as Azure, GCP and AWS

Education:

• Bachelor's degree or equivalent experience (Highschool diploma plus 4 years relevant work experience)

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

$101,970.00 - $203,940.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in our comprehensive and competitive mix of pay and benefits - investing in the physical, emotional and financial wellness of our colleagues and their families to help them be the healthiest they can be. In addition to our competitive wages, our great benefits include:

• Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan .

• No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching.

• Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.

For more information, visit

We anticipate the application window for this opening will close on: 10/03/2025

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.

We are an equal opportunity and affirmative action employer. We do not discriminate in recruiting, hiring, promotion, or any other personnel action based on race, ethnicity, color, national origin, sex/gender, sexual orientation, gender identity or expression, religion, age, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.

Summit Human Capital is seeking a highly motivated Remote AI Software Engineer to support one of our clients in the e-learning and corporate training and development industry. The ideal candidate will meet the following criteria:

Requirements:
• 1-3 years professional experience in AI/LLM application development.
• Strong Python programming skills.
• Experience deploying AI services on Azure OpenAI.
• Proven ability to build scalable, stateful AI systems.

Desired:
• Hands-on experience with LangChain (v0.3.6+), LangGraph (v0.2.43+), and Pydantic (v2.10+).
• Degree or experience in data science or machine learning.
• Background in agentic system design and multi-agent orchestration.

Responsibilities:
• Design and build multi-agent AI workflows using LangChain and LangGraph.
• Implement structured data flows and validation with Pydantic.
• Develop graph-based execution models for scalable SaaS applications.
• Integrate Azure OpenAI and related cloud services into production systems.
• Ensure reliability with error handling, retry logic, and state management.
• Extend systems with new agents, validation steps, and product features.
• Collaborate with product, UX, and DevOps to deliver production-ready features.
• Contribute to documentation, telemetry, and monitoring for continuous improvement.

• Design and ship distributed systems including continuous event-ingestion, and task-processing pipelines (e.g. AWS SQS, Lambda functions).
• Expose clean and highly available REST/gRPC APIs that power real-time permissioning decisions and agent orchestration.

• Own orchestration engines that reliably manage complex workflows across multiple LLMs and other AI services, building the intelligent control plane for cost, latency, and security.
• Solve the unique systems challenges of production AI: engineering for non-determinism, guaranteeing data provenance throughout complex transformations, and building the operational hooks needed to monitor, debug, and continuously improve our AI systems.

• Bake enterprise-grade security into every service, implementing multi-tenant isolation, fine-grained IAM, encryption-at-rest, and auditable trails that meet stringent compliance needs.
• Own the operational excellence of your services by implementing and monitoring comprehensive instrumentation using tools like Prometheus and OpenTelemetry.

• Serve as a pillar of engineering quality, writing clear Architecture Decision Records and providing thoughtful code reviews.

• You have 4+ years of experience shipping complex backend systems in high-growth environments where quality and speed are not mutually exclusive.
• You thrive at the intersection of distributed systems and machine learning. You see LLMs not just as a black box to call, but as a new class of architectural component that requires first-principles thinking to deploy safely and reliably at scale.
• You possess a first-principles understanding of distributed systems: Concurrency, consistency, and event-driven architectures are your native language.
• You have expert-level fluency in Python or TypeScript/Node.js , and you're comfortable operating across synchronous APIs and asynchronous worker pools.
• You have a hands-on cloud backgroundand experience turning architectural diagrams into reality with IaC and container orchestration.
• You have a profound sense of ownership, taking pride in the operational excellence of your services and instinctively mentoring others through the quality of your work.
• You are a clear communicator and an empathetic collaborator.

• Compensation: $40 K - 190 K + equity
• Location: Hybrid (Seattle, WA)
• Visa: We do not sponsor visas for this role at this time
• Benefits: Company-paid health coverage (including dependents)

• Design and Develop: Build a conversational engagement platform leveraging advanced LLM capabilities and modern cloud infrastructure (Azure, AWS, GCP).
• Full Development Lifecycle: Manage development, testing, deployment, and monitoring of the platform to ensure reliability and scalability.
• AI Integration: Fine-tune and embed AI prompts into applications to automate complex tasks and improve customer experience.
• API Development: Define and implement clean, robust REST APIs to support secure, high-performance, and scalable systems.
• Code Quality: Maintain high-quality standards through rigorous testing, best practices, and thorough documentation.
• Documentation: Keep clear and up-to-date documentation for external developer APIs and internal systems.
• Collaboration: Work closely with scientists, engineers, product managers and internal stakeholders to identify and solve problems efficiently.
• Other duties as assigned.

• Aligns with our values: People, Commitment, Aspiration, Trustworthiness & Impact
• Bachelor's degree in computer science or related field
• Minimum of 3 years in software engineering with a focus on scalable, production-grade systems.
• Programming Expertise: Strong proficiency in Python, with a deep understanding of software architecture for security, reliability, and performance.
• API Design: Proven ability to design clean, robust REST APIs.
• Cloud Infrastructure: Experience with Infrastructure-as-Code tools (e.g., Terraform) and major cloud platforms like Azure, AWS, or GCP.
• Database Management: Familiarity with relational databases such as Postgres or MySQL.
• Containerization: Hands-on experience with Docker for streamlined development and deployment workflows.
• AI Tools & Stacks: Knowledge of AI tooling and frameworks, including LlamaIndex, LangChain, and vector databases, such as Chroma, Pinecone.

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Training & Development
• Work From Home

AI Software Engineer

What you can expect

As an AI Engineer, you will collaborate to design, implement, and optimize AI algorithms and software applications. You will ensure AI training, inference, deployment, and operation are functional, reliable, and scalable in your role.

About the Team

Zoom is seeking a highly passionate AI Software Engineer to join our AI infrastructure team. This AI Software Engineer plays a pivotal role in developing and enhancing AI-powered software solutions.

Responsibilities

• Collaborating with multidisciplinary teams to understand project requirements and objectives.

• Implementing AI solutions solves complex problems in computer vision, natural language processing and recommendation systems.

• Designing, developing, and maintaining AI algorithms, models, and software applications.

• Ensuring software reliability and quality by participating in code reviews, testing, and debugging.

• Documenting code, algorithms, and technical processes for internal and external reference.

What we're looking for

• Possess a Bachelor's Degree in Computer Science, AI, Machine learning or a related field.

• Minimum 3+ years of industry experience or relevant work in a related field.

• Demonstrate deep understanding and skill in software engineering, AI, ASR or machine learning through experience.

• Be proficient in programming languages such as C++ programming; fluent Python programming; algorithm experience.

• Have experience with deep learning, neural networks, and data preprocessing.

• Have a solid comprehension of AI concepts, algorithms, and frameworks (e.g. TensorFlow, PyTorch).

• Be knowledgeable about software development best practices and version control systems (e.g. Git).

Salary Range or On Target Earnings:

Minimum:

$143,000.00

Maximum:

$312,800.00

In addition to the base salary and/or OTE listed Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus and equity value.

Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience.

We also have a location based compensation structure; there may be a different range for candidates in this and other locations.

Ways of WorkingOur structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

BenefitsAs part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn ( for more information.

About UsZoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.We're problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

Our Commitment?

At Zoom, we believe great work happens when people feel supported and empowered. We're committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know-we're here to support you at every step.

We welcome people of different backgrounds, experiences, abilities and perspectives including qualified applicants with arrest and conviction records and any qualified applicants requiring reasonable accommodations in accordance with the law.

If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form ( and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.

Think of this opportunity as a marathon, not a sprint! We're building a strong team at Zoom, and we're looking for talented individuals to join us for the long haul. No need to rush your application - take your time to ensure it's a good fit for your career goals. We continuously review applications, so submit yours whenever you're ready to take the next step.

Job Description

We are seeking a highly motivated and technically skilled AI Engineer to join our growing team. The ideal candidate will have a solid background in software development and hands-on experience designing and building agentic workflows. This role offers an exciting opportunity to work on cutting-edge AI systems and contribute to the development of intelligent, autonomous solutions that drive business value.

Duties and Responsibilities

Design, build, and maintain agentic workflows and autonomous systems

Develop and integrate AI models into production-grade applications

Collaborate with cross-functional teams to gather requirements and deliver AI-driven solutions

Implement orchestration logic for multi-agent systems and task automation

Write clean, scalable, and maintainable code in support of AI initiatives

Monitor and optimize the performance of AI systems in production

Stay current with advancements in AI, LLMs, and agentic architectures

Requirements and Qualifications

This role is a hybrid between an AI engineer, data scientist, and software developer, designed for someone who can operate across the full lifecycle of AI system development.

The work involves using AWS tools to design and build AI-driven systems not just training or fine-tuning models, but also crafting effective prompts, validating model performance through data analysis, and managing risks like hallucinations or bias.

The role requires building prototype-level data pipelines that move data to and from models for training, evaluation, and review.

Strong software development skills with proficiency in Python,JupyterHub, GitHub, Visual Studio, etc.

Exposure to designing and building agentic workflows or multi-agent systems.

Familiarity with orchestration frameworks (e.g., LangChain, AutoGen, CrewAI, or similar)

Solid understanding of AI/ML concepts, including LLMs and prompt engineering

Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization (Docker, Kubernetes)

Excellent problem-solving and communication skills

Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience)

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form ( . The EEOC "Know Your Rights" Poster is available here ( .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: .

Skills and Requirements

AI/ML concepts, including LLMs and prompt engineering

Knowledge of AWS services to design and build AI-driven systems

Strong knowledge of JupyterHub, Terraform and CI/CD pipelines Familiarity with orchestration frameworks (e.g., LangChain, AutoGen, CrewAI, or similar) null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to