2,288 Spark Developer jobs in the United States

The Candiadte will be responsible for leading technical teams and projects related to apache spark, scala, and python. The role involves overseeing the design, development, and implementation of scalable and efficient solutions using these technologies.

Key Responsibilities
1. Design and implementation of solutions using apache spark, scala, and python
2. Provide technical expertise and guidance to team members in resolving complex technical issues
3. Collaborate with stakeholders to gather requirements and define project scope
4. Ensure adherence to best practices in coding, testing, and deployment processes
5. Conduct code reviews and performance optimization activities
6. Troubleshoot and debug technical issues to ensure seamless project delivery
7. Stay updated with the latest trends and advancements in apache spark, scala, and python technologies
8. Mentor team members and facilitate knowledge sharing within the team

Skill Requirements
1. Strong proficiency in apache spark, scala, and python
2. Experience in leading technical teams and projects
3. Excellent problem-solving skills and ability to think critically
4. Solid understanding of software development life cycle
5. Good communication and interpersonal skills
6. Ability to work effectively in a collaborative team environment
7. Strong organizational and leadership abilities
8. Experience in performance tuning and optimization techniques
9. Knowledge of big data concepts and tools is a plus

Certifications : Relevant certifications in apache spark, scala, or python are a plus

• Develop, program, and maintain applications using the Apache Spark open-source framework
• Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming
• Spark Developer must have strong programming skills in Java, Scala, or Python
• Familiar with big data processing tools and techniques
• Proven experience as a Spark Developer or a related role
• Strong programming skills in Java, Scala, or Python
• Familiarity with big data processing tools and techniques
• Experience with the Hadoop ecosystem
• Good understanding of distributed systems
• Experience with streaming data platforms
• Excellent analytical and problem-solving skills

• Java springboot with microservice architecture knowledge
• REST/GraphQL
• Mongo
• k8s (preferably EKS)
• TDD, ATDD
• Java/Python Spark
• AWS: s3, Lambda, Step Function, AMQ, SNS, SQS, CloudWatch Events

About the job Spark Developer

Spark Developer needs Java/Spark developer with over 5 Years of hands on experience

Spark Developer requires:

• Locations; Charlotte, NC; Iselin, NJ
• Java Spark
• AWS, CDP

• Big Data Platform 5 years
• Experience with sqoop
• Experience working with large data set and understands how to tune code for performance.
• Experience working in retirement industry/financial institutions.
• Experience working in cloud (AWS/CDP Cloud)

• Assess the technical viability of emerging products and technologies.
• Work with developers and infrastructure specialists to test and evaluate new technologies.
• Participate in the development of business cases and obtaining approvals for capital expenditures.
• Monitor and analyze new technology product performance and resolving issues regarding potential improvements or modifications to complex situations, as needed.

Job Title: Java Spark Developer

Experience Level: 8-12 years

Location: Wilmington DE (5 Days Onsite Every Week)

Key Responsibilities include developing efficient data workflows, monitoring database performance, ensuring data governance and security, and working with cloud platforms (AWS, AWS Glue). Familiarity with.

Duration: Long term Location: Broadway, NY 3 days onsite Mandatory Skills: Big Data, Scala, Spark, Core Java Experience: As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing application. Key Responsibilities: Develop and maintain data processing applications using Sp.

**Title: Scala/ Spark Developer Duration: Long term** **Location: Broadway, NY - 3 days onsite** **Mandatory Skills:** Big Data, Scala, Spark, Core Java **Experience:** As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing application. **Key Responsibilities:** - Develop and maintain data processing applications using Spark and Scala. - Collaborate with cross-functional teams to understand data requirements and design efficient solutions. - Implement test-driven deployment practices to enhance the reliability of application. - Deploy artifacts from lower to higher environment ensuring smooth transition - Troubleshoot and debug Spark performance issues to ensure optimal data processing. - Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time - Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies: - Strong knowledge of Scala programming language - Excellent problem-solving and analytical skills. - Proficiency in Spark, including the development and optimization of Spark applications. - Ability to troubleshoot and debug performance issues in Spark. - Understanding of design patterns and data structure for efficient data processing - Familiarity with database concepts and SQL * Java and Snowflake (Good to have). - Experience with test-driven deployment practices (Good to have). - Familiarity with Python (Good to have). - Knowledge of Databricks (Good to have). - Understanding of DevOps practices (Good to have).

**Mandatory Skills:** Big Data, Scala, Spark, Core Java

Scala & Spark Developer
Location- Sunnyvale, CA / Austin, TX
No of position : 3

Job Description:
5 - 7 years of overall experience.
4+ years of experience of building and supporting scalable Big Data applications. Working in a software product development organisation building modern and scalable pipelines and delivering data promptly in a collaborative team environment.
Proficiency in Hadoop technologies and Big Data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive, Airflow. Shell scrpting.
Strong and exceptional knowledge of Spark Engine, Spark and Scala.
Hands on experience with data processing technologies, ETL processes and feature engineering
Expertise in Data Analytics, PL/SQL, NoSQL.
Strong analytical and troubleshooting skills.
Strong interpersonal skills and ability to work effectively across multiple business and technical teams
Excellent oral and written communication skills
Ability to independently learn new technologies.
Passionate, team player and fast leaner.

Additional Nice to Have:

Experience in commonly used cloud services.
Expertise in columnar storage such as Parquet, Iceberg.
Knowledge in deep learning models

Title: Scala/ Spark Developer Duration: Long term

Location: Broadway, NY - 3 days onsite

Mandatory Skills: Big Data, Scala, Spark, Core Java

Experience: As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing application. Key Responsibilities:

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
• Implement test-driven deployment practices to enhance the reliability of application.
• Deploy artifacts from lower to higher environment ensuring smooth transition
• Troubleshoot and debug Spark performance issues to ensure optimal data processing.
• Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time
• Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies:
• Strong knowledge of Scala programming language
• Excellent problem-solving and analytical skills.
• Proficiency in Spark, including the development and optimization of Spark applications.
• Ability to troubleshoot and debug performance issues in Spark.
• Understanding of design patterns and data structure for efficient data processing
• Familiarity with database concepts and SQL * Java and Snowflake (Good to have).
• Experience with test-driven deployment practices (Good to have).
• Familiarity with Python (Good to have).
• Knowledge of Databricks (Good to have).
• Understanding of DevOps practices (Good to have).

Direct message the job poster from Infosys

Infosys is seeking Lead Java Spark Developer. In this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle in Java and Spark. You will build high-throughput, fault-tolerant systems with requirements including elicitation, application architecture, definition, and design. You will play a key role in creating high-level design artifacts and delivering high-quality code for modules, leading validation for testing, and supporting activities related to implementation, transition, and warranty. This role fosters a learning culture where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is valued.

Candidate must be within commuting distance of Irving, TX or Tampa, FL or willing to relocate. Travel to project locations may be required.

Required Qualifications:

• Bachelors degree or foreign equivalent from an accredited institution; three years of progressive experience in the field may be considered in lieu of every year of education.
• Minimum 4 years of Information Technology experience.
• Hands-on experience in software development using Java and Spark.

Preferred Qualifications:

• Over 8 years of relevant experience in application development.
• At least 4 years of experience in Enterprise Java / J2EE technology.
• At least 4 years of experience with Big Data, Apache Spark streaming, and batch frameworks.
• Experience programming Spark SQL, HIVE, Hadoop, and Java for Spark.
• Experience with Microservices architecture.
• Unix Shell scripting skills.
• Experience working in Agile, Scrum, and TDD environments.
• Hands-on development experience with good communication skills.
• Experience with DevOps practices like Pipelines, CI/CD is preferred.
• Knowledge of Domain-Driven Design is essential.
• Strong analytical skills.
• High initiative, flexibility, and customer orientation.
• Excellent verbal and written communication skills.
• Experience and interest in working in a global delivery environment.

• Mid-Senior level

• Full-time

• Information Technology

• IT Services and IT Consulting

Referrals can double your chances of interviewing at Infosys.