1,613 Solutions Big Data jobs in the United States

Akkodis is seeking a Big Data Engineer for a Contract job with a client in Plano, TX(Hybrid) . Responsibilities include developing processes to interact with HDFS and Oracle, creating workflows using Autosys, and ensuring ML/AI models are production-ready while working in an agile environment.

Rate Range: $ 60 /hour to $0/hour; The rate may be negotiable based on experience, education, geographic location, and other factors.

Big Data Engineer job responsibilities include:

• Develop and enhance application components for supporting ML/AI models and data ingestion processes with a focus on code resiliency and stability.
• Build processes to interact with HDFS and Oracle using Python/PySpark and Oracle PL/SQL.
• Create, schedule, and manage workflows and jobs using Autosys.
• Collaborate with development teams to contribute to story refinement and deliver data requirements throughout the delivery life cycle.
• Leverage architecture components to integrate, clean, transform, and control data as per acceptance criteria.
• Develop and execute test plans to identify issues, errors, and underlying causes, ensuring data accuracy and reliability.
• Drive complex information technology projects, ensuring on-time delivery and adherence to team delivery and release processes.
• Identify, define, and document data engineering requirements for deployment, maintenance, and business functionality.
• Work independently with strong analytical skills, while also being an excellent team player in a fast-paced agile environment.
• Contribute to data resiliency capabilities and ensure that ML/AI models are ready for production.

• BS/master's in computer science, Engineering, or a related field.
• 10+ years of relevant experience in Big Data engineering and development.
• Expertise in Oracle PL/SQL, Hadoop ecosystem, Hive Tables, and Python/PySpark.
• Experience in creating workflows and scheduling jobs using Autosys, with a strong background in machine learning and data resiliency.

• The California Fair Chance Act
• Los Angeles City Fair Chance Ordinance
• Los Angeles County Fair Chance Ordinance for Employers
• San Francisco Fair Chance Ordinance

Job Description

Insight Global is seeking a Big Data Engineer to assist with a application modernization and taking reports currently in the mainframe and recreate in a new modernized application. The output of those reports would be in Tableau or Excel and while this role is focused on Big Data Technologies, will primarily focus on the reporting for the initial duration of the contract.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

At least 6+ Years of experience with PySpark and MapR

Programming background with Python

Experience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.

Experience with PowerBI and/or Tableau null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer in Chandler, AZ (Hybrid).

Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

Contract Duration: 24 Months
Required Skills & Experience

• 4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.
• Minimum 4 years of hand on experience with
  • Building data pipeline using big-data stack (Hadoop, Hive, pySpark, python)
  • Amazon AWS S3 - Object storage, security, data service integration with S3
  • Data modelling and database design.
  • Job Scheduler - Autosys
  • PowerBI, Dremio
  • Unix/shell scripting, CICD pipeline

• Exposure in GCP cloud data engineering

• Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.
• Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.
• Contribute to the resolution of moderately complex issues and consult with others to meet Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements.
• Collaborate with client personnel in Software Engineering.

• Medical Insurance - Four medical plans to choose from for you and your family
• Dental & Orthodontia Benefits
• Vision Benefits
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
• Hospital Indemnity Insurance
• 401(k) including match with pre and post-tax options
• Paid Sick Time Leave
• Legal and Identity Protection Plans
• Pre-tax Commuter Benefit
• 529 College Saver Plan

• Software Engineering

Big Data Engineer

CHANDLER, Arizona

Hybrid

Contract

$53.56/hr - $60.35/hr

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer in Chandler, AZ (Hybrid).

Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

Contract Duration: 24 Months

Required Skills & Experience

• 4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

• Minimum 4 years of hand on experience with

• Building data pipeline using big-data stack (Hadoop, Hive, pySpark, python)

• Amazon AWS S3 - Object storage, security, data service integration with S3

• Data modelling and database design.

• Job Scheduler - Autosys

• PowerBI, Dremio

• Unix/shell scripting, CICD pipeline

Desired Skills & Experience

• Exposure in GCP cloud data engineering

What You Will Be Doing

• Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.

• Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.

• Contribute to the resolution of moderately complex issues and consult with others to meet Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements.

• Collaborate with client personnel in Software Engineering.

You will receive the following benefits:

• Medical Insurance - Four medical plans to choose from for you and your family

• Dental & Orthodontia Benefits

• Vision Benefits

• Health Savings Account (HSA)

• Health and Dependent Care Flexible Spending Accounts

• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance

• Hospital Indemnity Insurance

• 401(k) including match with pre and post-tax options

• Paid Sick Time Leave

• Legal and Identity Protection Plans

• Pre-tax Commuter Benefit

• 529 College Saver Plan

Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP's Employment Accommodation policy. Applicants need to make their needs known in advance.

Posted by: Blair Richardson

Specialization:

• Software Engineering

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

OVERALL SKILLS

• Full life cycle experience, responsible for the development of a complete set of architectural views
• Experience of at least one of the commonly-used methods, notations and tools (E.g. Rational Suite, Artisan, System Architect, UML, RUP, others).
• Experience of software development methodologies and structured approaches to system development
• Led pre-sales solutioning and customer presentations
• Translate complex functional and technical requirements into detailed design.
• Systems thinking - the ability to see how parts interact with the whole (big picture thinking)
• Knowledge of the business for which the enterprise architecture is being developed
• Interpersonal and leadership skills - Communication(written/spoken), collaboration, facilitation, and negotiation skills
• Strong business analysis skills and experience, including functional decomposition, requirements capture, process modelling. Strong knowledge of design and architectural patterns.
• Sound knowledge of common architecture frameworks like Zachman or TOGAF etc.

GOOD TO HAVE

• He/She must be comfortable with leading a cross-functional team of architects and analysts within business, application/systems, data/information and technical architecture disciplines.
• He/She must be experienced in presenting and explaining the architectural views to clients at all levels from technical/IT staff to Board/Director.
• Played significant role in propagating/selling/revenue generation on significant solution accelerators/differentiators/IP
• Played significant role in business development for large customers
• Presented papers/technical forum participation in global forum

Analytical Skills

• Experience in advance analytics and well versed with different predictive models with understanding in SQL
• Hands on experience in different machine learning algorithms, like logistic regression, linear regression, random forest, Neural Networks, Time Series.
• Ability to present results of statistical models in business language

Design analytical solution to clients problems, identify data requirement and develop analytical plan

** U.S. citizens and those who are authorized to work independently in the United States are encourage to apply. We are unable to sponsor at this time .

Note:-

• This is aContract job opportunity.
• OnlyUS Citizen ,Green Card Holder ,GC-EAD ,H4-EAD, L2-EAD, H1B and TN Visa can apply.
• NoOPT-EAD candidates please.
• Please mention yourImmigration Status while applying .
• Allyour information will be kept confidential according toEEO guidelines.

Join to apply for the Big Data Architect role at DTI

1 day ago Be among the first 25 applicants

Join to apply for the Big Data Architect role at DTI

Who We Are

Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop.

What We Do

We focus on providing delivery, staffing, and supported services such as enterprise integration/implementations including, but not limited to, CRM, EAM, ERP, PMO, and QA. We service clients in SLED (state/local gov't & education), financial services, fortune, public utility, as well as regularly partnering with Big 4 SI partners.

Are you a

5 Months Contract.

Job Title: Big Data Architect

Location: Phoenix, AZ ,

Duration: 5 Months contract (08/04/2025 to 12/31/2025)

Work Setup: Hybrid expected to be in-office Tuesday through Thursday, per company policy

Primary Skill Required for the Role: GCP Data Engineer

Level Required for Primary Skill: Advanced (6-9 years experience)

Description

Looking for a seasoned Software Engineer with big data and full-stack development expertise. This role will be pivotal in maintaining and modifying existing NIFI jobs, migrating existing big data, NIFI and java rest APIs to the Google Cloud Platform (GCP).

Who We Are

Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop.

What We Do

We focus on providing delivery, staffing, and supported services such as enterprise integration/implementations including, but not limited to, CRM, EAM, ERP, PMO, and QA. We service clients in SLED (state/local gov't & education), financial services, fortune, public utility, as well as regularly partnering with Big 4 SI partners.

Are you a Big Data Architect looking for your next contract? If so, we want to speak to you! DTI has an immediate need for a Big Data Architect for a 5 Months Contract.

Must work on our W2

Job Title: Big Data Architect

Location: Phoenix, AZ ,

Duration: 5 Months contract (08/04/2025 to 12/31/2025)

Work Setup: Hybrid expected to be in-office Tuesday through Thursday, per company policy

Primary Skill Required for the Role: GCP Data Engineer

Level Required for Primary Skill: Advanced (6-9 years experience)

Description

Looking for a seasoned Software Engineer with big data and full-stack development expertise. This role will be pivotal in maintaining and modifying existing NIFI jobs, migrating existing big data, NIFI and java rest APIs to the Google Cloud Platform (GCP).

Minimum Qualifications

• BS in computer science, computer engineering, or other technical discipline, or equivalent work experience.
• Hands-on software development experience with GCP, AWS or other Cloud/Big Data solutions.
• Experience working with Hadoop, MapR, Hive, Spark, shell scripting, GCP clusters and distributed (multi-tiered) systems.
• Proficiency in developing and optimizing data pipelines using NIFI or GCP Cloud Dataflow.
• Experience building event processing pipelines with Kafka or GCP Pub Sub.
• Hands-on experience with SQL and HSQL, and multiple storage technologies including RDBMS, document stores, and search indices.
• Hands-on experience with cloud services for application development and deployment such as Kubernetes, docker, etc.
• Experience in developing REST APIs using Springboot or Apache Camel.
• Hands-on experience setting up instrumentation, analyzing performance, distributed tracing, and debugging using tools like Dynatrace, Splunk, etc.
• Strong Object-Oriented Programming skills, SOLID principles, and design patterns; preferably Java.
• Good knowledge of CICD pipelines and source code management tools (XLR, Jenkins, GitHub).
• Familiarity with Agile & scrum ceremonies.
  
  

• Certifications in cloud platform (GCP Professional Data Engineer) is a plus.
• Salesforce knowledge or prior experience integrating with the salesforce platform is a major plus.
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Engineering and Information Technology
• Industries IT Services and IT Consulting and Construction

Referrals increase your chances of interviewing at DTI by 2x

Greater Phoenix Area 121,000.00- 165,000.00 1 week ago

Phoenix, AZ 170,000.00- 255,000.00 1 week ago

Phoenix, AZ 99,000.00- 146,000.00 6 days ago

Phoenix, AZ 110,000.00- 190,000.00 3 weeks ago

Phoenix, AZ 119,230.00- 166,598.00 2 weeks ago

Phoenix, AZ 119,230.00- 166,598.00 1 week ago

Tempe, AZ 85,500.00- 147,160.00 2 days ago

Tempe, AZ 118,200.00- 204,300.00 2 weeks ago

Phoenix, AZ 100,000.00- 135,000.00 1 week ago

Phoenix, AZ 170,000.00- 255,000.00 3 days ago

Phoenix, AZ 151,200.00- 200,450.00 3 weeks ago

Phoenix, AZ 150,000.00- 185,000.00 2 days ago

Phoenix, AZ 190,000.00- 210,000.00 2 weeks ago

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Innova Solutions has a client that is immediately hiring for a Big Data Engineer.

Job title: Big Data Engineer
Position type: Full-time/Contract
Duration: 24 Months
Location: Chandler, AZ (Hybrid)

As a Big Data Engineer, you will:

• Design, develop, and maintain scalable data pipelines using Hadoop, Hive, PySpark, and Python.
• Integrate and manage data services with Amazon AWS S3, ensuring security and compliance.
• Perform data modeling and database design using MySQL or similar relational databases.
• Implement and manage job scheduling usingAutosys.
• Automate data workflows and transformations using Spark, Python, and shell scripting.
• Collaborate with stakeholders to understand data requirements and deliver actionable insights.
• Utilize tools like Power BI and Dremio for data visualization and exploration.

• Experiencein software/data engineering.
• Strong experience with Hadoop, Hive, PySpark, Python
• AWS S3 and data service integration
• Data modeling and relational database design
• Autosys job scheduler
• Unix/Shell scripting
• CI/CD pipelines
• Power BI and Dremio
• Solid understanding of software engineering policies, procedures, and compliance requirements.

• Named One of America's Best Employers for New Grads by Forbes (2024)
• Named One of the Best Companies to Work for by U.S. News & World Report (Private Companies List, 2024-2025)
• One of the Largest IT Staffing Firms in the US - Ranked #3 by Staffing Industry Analysts (SIA, 2024)
• One of the Largest Staffing Firms in the US - Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics)
• Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023)
• One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024)
• AWS Advanced Tier Services Partner with 100+ certifications

• Design and implement end-to-end big data solutions
• Develop and enforce data governance policies
• Collaborate with teams to define data strategies
• Optimize performance of data pipelines
• Ensure compliance with data security standards
• Research and adopt emerging big data technologies

• Proficiency in Hadoop, Spark, and Kafka
• Expertise in data pipeline tools (e.g., Apache NiFi)
• Advanced programming in Python or Scala
• Strong knowledge of NoSQL databases
• Ability to design scalable cloud architectures
• Experience with version control systems

• Familiarity with real-time analytics tools
• Understanding of machine learning algorithms
• Experience with containerization (Docker/Kubernetes)
• Knowledge of edge computing frameworks
• Expertise in multi-cloud data management
• Hands-on experience with BI integration

• Excellent Salaries
• Flexible Work Schedule
• Cafeteria Style Benefits
• 10% - 401k Matching (Vested Immediately)
• Additional 401k Profit Sharing
• 30 days Paid Leave/Holiday (No Use or Lose!)
• The day off for your birthday
• Medical/Dental/Vision - 100% employee coverage. ($1200 allowance - or a bonus)
• HSA/FSA
• AFLAC
• Long Term/Short Term Disability - 100% employee coverage. No cost to you.
• Life Insurance - 100% employee coverage. No cost to you.
• Additional Discretionary Life Insurance
• Paid Training
• No long, wordy reviews with tons of paperwork!
• Referral bonus program with recurring annual payments