189 Frameworks Engineer jobs in the United States

• Design and develop fault-tolerant, high-concurrency distributed inference engine for text, image, and multimodal generation models.
• Implement and optimize distributed inference strategies, including Mixture of Experts (MoE) parallelism, tensor parallelism, pipeline parallelism for high-performance serving.
• Apply CUDA graph optimizations, TensorRT/TRT-LLM graph optimizations, and PyTorch-based compilation (torch.compile), and speculative decoding to enhance efficiency and scalability.

• Collaborate with hardware teams on performance bottleneck analysis, co-optimize inference performance for GPUs, TPUs, or custom accelerators.
• Work closely with AI researchers and infrastructure engineers to develop efficient model execution plans and optimize E2E model serving pipelines.

• Experience:
  • 3+ years of experience in deep learning inference frameworks, distributed systems, or high-performance computing.
• Technical Skills:
  • Familiar with at least one LLM inference frameworks (e.g., TensorRT-LLM, vLLM, SGLang, TGI(Text Generation Inference)).
  • Background knowledge and experience in at least one of the following: GPU programming (CUDA/Triton/TensorRT), compiler, model quantization, and GPU cluster scheduling.
  • Deep understanding of KV cache systems like Mooncake, PagedAttention, or custom in-house variants.
• Programming:
  • Proficient in Python and C++/CUDA for high-performance deep learning inference.
• Optimization Techniques:
  • Deep understanding of Transformer architectures and LLM/VLM/Diffusion model optimization.
  • Knowledge of inference optimization, such as workload scheduling, CUDA graph, compiled, efficient kernels
• Soft Skills:
  • Strong analytical problem-solving skills with a performance-driven mindset.
  • Excellent collaboration and communication skills across teams.

• Experience in developing software systems for large-scale data center networks with RDMA/RoCE
• Familiar with distributed filesystem(e.g., 3FS, HDFS, Ceph)
• Familiar with open source distributed scheduling/orchestration frameworks, such as Kubernetes (K8S)
• Contributions to open-source deep learning inference projects.

Meta is building products that make it easier for people to connect with the ones they love most, enjoy top-notch experiences, and push the future of computing platforms. We are a team of world-class experts developing and shipping products at the intersection of hardware, software, and content. As an OS Frameworks Engineer at Meta, you can help build new, innovative hardware and software that radically redefine the way people work, play, and connect. What we build today could one day be the norm. So to be here today is to truly be at the heart of change and the frontier of what's to come. We're the people helping to define the future of technology. We may not have all the answers. But together, we're getting closer.

Lead and set direction in how Meta develops its future functionality to deliver best-in-class VR devices.

Develop APIs in the system-level framework layer that allow other layers of the stack to implement compelling and performant use cases.

Collaborate with cross-functional teams of partners, product managers and engineers to build an end-to-end solution.

Work with Application and Platform teams to debug functional, performance and stability issues across the stack.

Build on OS internals. Set technical direction for significant improvements.

Uplift coding and design skills on the team through reviews and introduction of best practices. Model behaviors through clean readable code, upfront debugging and testability when implementing complex components.

Work closely with product management, application software engineers and partners to understand requirements, specify interfaces for new software frameworks, and enhance existing frameworks.

Participate in design reviews and code reviews for the team.

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

7+ years of Software development experience or PhD with 4+ years of experience.

3+ years of experience in developing any of the following: Desktop applications, Operating Systems, AOSP, Identity, Device management on iOS/Android, Device Security, Android Enterprise.

Experience with Android, macOS, or Windows internals or frameworks services.

Experience with coding in both C++ and Java.

1+ years of experience developing software for Mobile platforms (Android/iOS).

Experience with Android UI frameworks and services.

Experience with Android performance tools and security models.

3+ years of experience with any of the following: Android internals, AOSP, Android SDK, Android NDK, Android JNI, Android IPC mechanisms, Linux OS development.

$85.10/hour to $251,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Summary:

Meta is building products that make it easier for people to connect with the ones they love most, enjoy top-notch experiences, and push the future of computing platforms. We are a team of world-class experts developing and shipping products at the intersection of hardware, software, and content.As an OS Frameworks Engineer at Meta, you can help build new, innovative hardware and software that radically redefine the way people work, play, and connect. What we build today could one day be the norm. So to be here today is to truly be at the heart of change and the frontier of what's to come. We're the people helping to define the future of technology. We may not have all the answers. But together, we're getting closer.

Required Skills:

Software Engineer, OS Frameworks Responsibilities:

1. Lead and set direction in how Meta develops its future enhancements to deliver best-in-class VR devices

2. Develop APIs in the system-level framework layer that allow other layers of the stack to implement compelling and performant use cases

3. Collaborate with cross-functional teams of partners, product managers and engineers to build an end-to-end solution

4. Work with Application and Platform teams to debug functional, performance and stability issues across the stack

5. Build on OS internals. Set technical direction for significant improvements

6. Uplift coding and design skills on the team through reviews and introduction of best practices. Model behaviors through clean readable code, upfront debugging and testability when implementing complex components

7. Work closely with product management, application software engineers and partners to understand requirements, specify interfaces for new software frameworks, and enhance existing frameworks

8. Participate in design reviews and code reviews for the team

Minimum Qualifications:

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

2. 5+ years of Software development experience or PhD with 2+ years of experience

3. 3+ years of experience in developing any of the following: Operating Systems, AOSP, Identity, Device management on iOS/Android, Device Security, Android Enterprise

4. Experience with Android, macOS, or Windows internals or frameworks services

5. Experience coding in either C++ or Java

Preferred Qualifications:

Preferred Qualifications:

1. Experience with Android performance tools and security models

2. 3+ years of experience with any of the following: Android internals, AOSP, Android SDK, Android NDK, Android JNI, Android IPC mechanisms, Linux OS development

3. 1+ years of experience developing software for Mobile platforms (Android/iOS)

4. Experience with Android UI frameworks and services

Public Compensation:

$70.67/hour to $208,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at

Summary:

Meta is building products that make it easier for people to connect with the ones they love most, enjoy top-notch experiences, and push the future of computing platforms. We are a team of world-class experts developing and shipping products at the intersection of hardware, software, and content.As an OS Frameworks Engineer at Meta, you can help build new, innovative hardware and software that radically redefine the way people work, play, and connect. What we build today could one day be the norm. So to be here today is to truly be at the heart of change and the frontier of what's to come. We're the people helping to define the future of technology. We may not have all the answers. But together, we're getting closer.

Required Skills:

Software Engineer, OS Frameworks Responsibilities:

1. Lead and set direction in how Meta develops its future enhancements to deliver best-in-class VR devices

2. Develop APIs in the system-level framework layer that allow other layers of the stack to implement compelling and performant use cases

3. Collaborate with cross-functional teams of partners, product managers and engineers to build an end-to-end solution

4. Work with Application and Platform teams to debug functional, performance and stability issues across the stack

5. Build on OS internals. Set technical direction for significant improvements

6. Uplift coding and design skills on the team through reviews and introduction of best practices. Model behaviors through clean readable code, upfront debugging and testability when implementing complex components

7. Work closely with product management, application software engineers and partners to understand requirements, specify interfaces for new software frameworks, and enhance existing frameworks

8. Participate in design reviews and code reviews for the team

Minimum Qualifications:

Minimum Qualifications:

1. Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta

2. 2+ years of Software development experience or PhD degree +9 months of experience

3. Experience in developing any of the following: Desktop applications, Operating Systems, Android Open Source Project (AOSP), Identity, Device management on iOS/Android, Device Security, Android Enterprise

4. Experience with Android, macOS, or Windows internals or frameworks services

5. Experience with coding in C++ or Java

Preferred Qualifications:

Preferred Qualifications:

1. Experience with Android UI frameworks and services

2. 1+ years of experience developing software for Mobile platforms (Android/iOS)

3. Experience with Android performance tools and security models

4. 1+ years of experience with any of the following: Android internals, AOSP, Android SDK, Android NDK, Android JNI, Android IPC mechanisms, Linux OS development

Public Compensation:

$56.25/hour to $173,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at