10,652 Big Data jobs in the United States
Big data engineer
19355 Malvern, Pennsylvania
Randstad
Posted today
Job Viewed
Job Description
job summary:
Responsibilities
- We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team.
- You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including large language models (LLMs).
job type: Contract
salary: $56 - 61 per hour
work hours: 8am to 5pm
education: Bachelors
responsibilities:
- The ideal candidate will possess a robust background in traditional machine learning, deep learning, and significant experience with large datasets and cloud-based AI services.
- Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.
- Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.
- Collaborate with data science teams to review model-ready datasets and feature documentation, ensuring completeness and accuracy.
- Perform data discovery and analysis of raw data sources, applying business context to meet model development needs.
- Comfort with exploratory data exploration and tracking data lineage during inception or root cause analysis.
- Write and maintain model monitoring scripts, diagnosing issues and coordinating resolutions based on alerts.
Qualifications
- Around 5-8 years of relevant work experience.
- At least 3 years of hands-on experience designing ETL pipelines using AWS services (e.g., Glue, SageMaker).
- Proficiency in programming languages, particularly Python (including PySpark, PySQL) and familiarity with machine learning libraries and frameworks.
- Strong understanding of cloud technologies, including AWS and Azure.
- Experience with API design and development is a plus.
skills:
- Solid understanding of software engineering principles, including design patterns, testing, security, and version control.
- Familiarity with Feature Store usage, LLMs, GenAI, RAG, Prompt Engineering, and Model Evaluation.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
View Now
0
Big Data Engineer
19355 Malvern, Pennsylvania
Procyon TS
Posted 1 day ago
Job Viewed
Job Description
Responsibilities
Required Skills : Data Warehouse
Basic Qualification :
Additional Skills : Big Data
Background Check : No
Drug Screen : No
- Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files
- Expert in SQL
- AWS S3 and Glue experience
- Advanced Data Modeling principles
Required Skills : Data Warehouse
Basic Qualification :
Additional Skills : Big Data
Background Check : No
Drug Screen : No
View Now
1
Big Data Engineer
30383 Atlanta, Georgia
RIT Solutions, Inc.
Posted 2 days ago
Job Viewed
Job Description
Can send one Person.
Big Data Engineer
Malvern, PA - Hybrid
Job Description
Responsibilities
Qualifications
Big Data Engineer
Malvern, PA - Hybrid
Job Description
Responsibilities
- Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
- The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
- s an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications
- Proficiency in Python programming
- Strong expertise in SQL, Presto, HIVE, and Spark
- Knowledge of trading and investment dat
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs Write, maintain, and execute automated unit tests using Python
- Follow Test-Driven Development (TDD) practices in all stages of software development
- Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models, including normalization, denormalization, and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control, unit testing, test-driven development, and CI/CD
- bility to write clean, maintainable code and comprehend code written by others
- Strong communication skills
- Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
View Now
2
Big Data Engineer
22021 Chantilly, Virginia
Cymertek
Posted 2 days ago
Job Viewed
Job Description
Big Data Engineer
LOCATION
Chantilly, VA 20151
CLEARANCE
TS/SCI Full Poly (Please note this position requires full U.S. Citizenship)
KEY SUMMARY
We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cross-functional teams to handle large-scale datasets, implement best practices in data architecture, and explore innovative technologies in the big data ecosystem. The ideal candidate has a deep understanding of distributed systems, data processing frameworks, and a passion for leveraging data to drive impactful insights. If you are eager to work in a fast-paced, data-driven environment, we want to hear from you.
*** Please note that our job openings are dynamic and can open or close quickly (much faster than we can publish). If you do not see an opening you are looking for, know that we see almost all types of positons. We strive to keep our listings up to date, but please consider submitting your current resume. Our team will work with you to identify the most recent opportunities that align with your skillset and career goals. We look forward to you joining our family. ***
SIMILAR CAREER TITLES
Data Engineer, Data Architect, Hadoop Developer, Spark Engineer, ETL Developer, Data Platform Engineer, Cloud Data Engineer, Database Engineer, Data Infrastructure Engineer, Analytics Engineer, etc.
DEGREE (Level Desired)
Bachelor's Degree
DEGREE (Focus)
Computer Science, Data Science, Information Systems, Software Engineering, Electrical Engineering, Mathematics, Statistics, Computational Science, Information Technology, Applied Physics, etc.
ALTERNATE EXPERIENCE
General comment on degrees: Most contracts allow additional experience (4-5 years) in lieu of a Bachelor's Degree. Some contracts give 4-5 years experience credit for a Bachelor's Degree. Some contracts give 2 years experience credit for a Master's Degree. We will work with you to find the right fit.
POSITION RESPONSIBILITIES
YOUR FOREVER CAREER STARTS HERE
Are you looking for more than just a job? Join a company where employees are treated like family, and your career is built to last. We are a growing small business and a trusted federal contractor offering full scope consulting services in information technology, cybersecurity, and analyst workforce development.
At our company, you come first. We're committed to creating an environment where you'll thrive professionally and personally. We provide meaningful, challenging work using cutting-edge technologies while investing in your growth and success. With direct access to company leadership, a laid-back and inclusive atmosphere, and exceptional work-life balance, you'll feel valued every day.
We also believe in taking care of our family - both yours and ours. Our benefits are phenomenal, family-friendly, and designed with your well-being in mind. From employee and family events to career-long support, we create a community you'll never want to leave.
Ready to make your next move the best one? Join us and experience the difference.
BENEFITS
HOW TO APPLY
Email us at or apply today:
Want to see what our employees think? Click here .
EQUAL OPPORTUNITY EMPLOYER STATEMENT
Cymertek is proud to be an Equal Opportunity Employer committed to fostering an inclusive and diverse workplace. We embrace and celebrate differences in our employees, recognizing that a diverse workforce enhances our creativity, innovation, and overall success. At Cymertek, employment decisions are made based on merit, qualifications, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by applicable laws. We believe in creating an environment where all individuals are treated with respect and dignity, and where opportunities for professional growth and advancement are accessible to everyone, regardless of background or identity.
LOCATION
Chantilly, VA 20151
CLEARANCE
TS/SCI Full Poly (Please note this position requires full U.S. Citizenship)
KEY SUMMARY
We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cross-functional teams to handle large-scale datasets, implement best practices in data architecture, and explore innovative technologies in the big data ecosystem. The ideal candidate has a deep understanding of distributed systems, data processing frameworks, and a passion for leveraging data to drive impactful insights. If you are eager to work in a fast-paced, data-driven environment, we want to hear from you.
*** Please note that our job openings are dynamic and can open or close quickly (much faster than we can publish). If you do not see an opening you are looking for, know that we see almost all types of positons. We strive to keep our listings up to date, but please consider submitting your current resume. Our team will work with you to identify the most recent opportunities that align with your skillset and career goals. We look forward to you joining our family. ***
SIMILAR CAREER TITLES
Data Engineer, Data Architect, Hadoop Developer, Spark Engineer, ETL Developer, Data Platform Engineer, Cloud Data Engineer, Database Engineer, Data Infrastructure Engineer, Analytics Engineer, etc.
DEGREE (Level Desired)
Bachelor's Degree
DEGREE (Focus)
Computer Science, Data Science, Information Systems, Software Engineering, Electrical Engineering, Mathematics, Statistics, Computational Science, Information Technology, Applied Physics, etc.
ALTERNATE EXPERIENCE
General comment on degrees: Most contracts allow additional experience (4-5 years) in lieu of a Bachelor's Degree. Some contracts give 4-5 years experience credit for a Bachelor's Degree. Some contracts give 2 years experience credit for a Master's Degree. We will work with you to find the right fit.
POSITION RESPONSIBILITIES
- Experience with designing scalable data pipelines
- Proficiency in managing big data tools
- Strong understanding of distributed systems
- Expertise in data storage optimization
- Familiarity with data governance practices
- Ability to ensure data pipeline reliability
- Proficiency in programming (e.g., Java, Python)
- Expertise in data processing frameworks (e.g., Spark)
- Skill in working with data storage systems (e.g., HDFS)
- Familiarity with data query tools (e.g., SQL)
- Ability to handle structured and unstructured data
- Proficiency in data workflow orchestration tools
- Knowledge of real-time data processing
- Experience with stream processing frameworks
- Familiarity with NoSQL databases
- Expertise in cloud-based big data solutions
- Understanding of data visualization techniques
- Knowledge of emerging big data technologies
YOUR FOREVER CAREER STARTS HERE
Are you looking for more than just a job? Join a company where employees are treated like family, and your career is built to last. We are a growing small business and a trusted federal contractor offering full scope consulting services in information technology, cybersecurity, and analyst workforce development.
At our company, you come first. We're committed to creating an environment where you'll thrive professionally and personally. We provide meaningful, challenging work using cutting-edge technologies while investing in your growth and success. With direct access to company leadership, a laid-back and inclusive atmosphere, and exceptional work-life balance, you'll feel valued every day.
We also believe in taking care of our family - both yours and ours. Our benefits are phenomenal, family-friendly, and designed with your well-being in mind. From employee and family events to career-long support, we create a community you'll never want to leave.
Ready to make your next move the best one? Join us and experience the difference.
BENEFITS
- Excellent Salaries
- Flexible Work Schedule
- Cafeteria Style Benefits
- 10% - 401k Matching (Vested Immediately)
- Additional 401k Profit Sharing
- 30 days Paid Leave/Holiday (No Use or Lose!)
- The day off for your birthday
- Medical/Dental/Vision - 100% employee coverage. ($1200 allowance - or a bonus)
- HSA/FSA
- AFLAC
- Long Term/Short Term Disability - 100% employee coverage. No cost to you.
- Life Insurance - 100% employee coverage. No cost to you.
- Additional Discretionary Life Insurance
- Paid Training
- No long, wordy reviews with tons of paperwork!
- Referral bonus program with recurring annual payments
HOW TO APPLY
Email us at or apply today:
Want to see what our employees think? Click here .
EQUAL OPPORTUNITY EMPLOYER STATEMENT
Cymertek is proud to be an Equal Opportunity Employer committed to fostering an inclusive and diverse workplace. We embrace and celebrate differences in our employees, recognizing that a diverse workforce enhances our creativity, innovation, and overall success. At Cymertek, employment decisions are made based on merit, qualifications, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by applicable laws. We believe in creating an environment where all individuals are treated with respect and dignity, and where opportunities for professional growth and advancement are accessible to everyone, regardless of background or identity.
View Now
3
Big Data Engineer
28245 Charlotte, North Carolina
Syntricate Technologies
Posted 2 days ago
Job Viewed
Job Description
Required Skills:
- Applicant should be familiar with the following technologies/skillsets:
- Big Data knowhow is mandatory
- Big Data pipelines
- Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3)
- Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python.
- Familiarity and good knowledge of SQL
View Now
4
Big Data Engineer
22184 Vienna, Virginia
Cymertek
Posted 2 days ago
Job Viewed
Job Description
Big Data Engineer
LOCATION
Tysons, VA 22182
CLEARANCE
TS/SCI Full Poly (Please note this position requires full U.S. Citizenship)
KEY SUMMARY
We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cross-functional teams to handle large-scale datasets, implement best practices in data architecture, and explore innovative technologies in the big data ecosystem. The ideal candidate has a deep understanding of distributed systems, data processing frameworks, and a passion for leveraging data to drive impactful insights. If you are eager to work in a fast-paced, data-driven environment, we want to hear from you.
*** Please note that our job openings are dynamic and can open or close quickly (much faster than we can publish). If you do not see an opening you are looking for, know that we see almost all types of positons. We strive to keep our listings up to date, but please consider submitting your current resume. Our team will work with you to identify the most recent opportunities that align with your skillset and career goals. We look forward to you joining our family. ***
SIMILAR CAREER TITLES
Data Engineer, Data Architect, Hadoop Developer, Spark Engineer, ETL Developer, Data Platform Engineer, Cloud Data Engineer, Database Engineer, Data Infrastructure Engineer, Analytics Engineer, etc.
DEGREE (Level Desired)
Bachelor's Degree
DEGREE (Focus)
Computer Science, Data Science, Information Systems, Software Engineering, Electrical Engineering, Mathematics, Statistics, Computational Science, Information Technology, Applied Physics, etc.
ALTERNATE EXPERIENCE
General comment on degrees: Most contracts allow additional experience (4-5 years) in lieu of a Bachelor's Degree. Some contracts give 4-5 years experience credit for a Bachelor's Degree. Some contracts give 2 years experience credit for a Master's Degree. We will work with you to find the right fit.
POSITION RESPONSIBILITIES
YOUR FOREVER CAREER STARTS HERE
Are you looking for more than just a job? Join a company where employees are treated like family, and your career is built to last. We are a growing small business and a trusted federal contractor offering full scope consulting services in information technology, cybersecurity, and analyst workforce development.
At our company, you come first. We're committed to creating an environment where you'll thrive professionally and personally. We provide meaningful, challenging work using cutting-edge technologies while investing in your growth and success. With direct access to company leadership, a laid-back and inclusive atmosphere, and exceptional work-life balance, you'll feel valued every day.
We also believe in taking care of our family - both yours and ours. Our benefits are phenomenal, family-friendly, and designed with your well-being in mind. From employee and family events to career-long support, we create a community you'll never want to leave.
Ready to make your next move the best one? Join us and experience the difference.
BENEFITS
HOW TO APPLY
Email us at or apply today:
Want to see what our employees think? Click here .
EQUAL OPPORTUNITY EMPLOYER STATEMENT
Cymertek is proud to be an Equal Opportunity Employer committed to fostering an inclusive and diverse workplace. We embrace and celebrate differences in our employees, recognizing that a diverse workforce enhances our creativity, innovation, and overall success. At Cymertek, employment decisions are made based on merit, qualifications, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by applicable laws. We believe in creating an environment where all individuals are treated with respect and dignity, and where opportunities for professional growth and advancement are accessible to everyone, regardless of background or identity.
LOCATION
Tysons, VA 22182
CLEARANCE
TS/SCI Full Poly (Please note this position requires full U.S. Citizenship)
KEY SUMMARY
We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize data storage solutions to support business intelligence and analytics needs. You will work closely with cross-functional teams to handle large-scale datasets, implement best practices in data architecture, and explore innovative technologies in the big data ecosystem. The ideal candidate has a deep understanding of distributed systems, data processing frameworks, and a passion for leveraging data to drive impactful insights. If you are eager to work in a fast-paced, data-driven environment, we want to hear from you.
*** Please note that our job openings are dynamic and can open or close quickly (much faster than we can publish). If you do not see an opening you are looking for, know that we see almost all types of positons. We strive to keep our listings up to date, but please consider submitting your current resume. Our team will work with you to identify the most recent opportunities that align with your skillset and career goals. We look forward to you joining our family. ***
SIMILAR CAREER TITLES
Data Engineer, Data Architect, Hadoop Developer, Spark Engineer, ETL Developer, Data Platform Engineer, Cloud Data Engineer, Database Engineer, Data Infrastructure Engineer, Analytics Engineer, etc.
DEGREE (Level Desired)
Bachelor's Degree
DEGREE (Focus)
Computer Science, Data Science, Information Systems, Software Engineering, Electrical Engineering, Mathematics, Statistics, Computational Science, Information Technology, Applied Physics, etc.
ALTERNATE EXPERIENCE
General comment on degrees: Most contracts allow additional experience (4-5 years) in lieu of a Bachelor's Degree. Some contracts give 4-5 years experience credit for a Bachelor's Degree. Some contracts give 2 years experience credit for a Master's Degree. We will work with you to find the right fit.
POSITION RESPONSIBILITIES
- Experience with designing scalable data pipelines
- Proficiency in managing big data tools
- Strong understanding of distributed systems
- Expertise in data storage optimization
- Familiarity with data governance practices
- Ability to ensure data pipeline reliability
- Proficiency in programming (e.g., Java, Python)
- Expertise in data processing frameworks (e.g., Spark)
- Skill in working with data storage systems (e.g., HDFS)
- Familiarity with data query tools (e.g., SQL)
- Ability to handle structured and unstructured data
- Proficiency in data workflow orchestration tools
- Knowledge of real-time data processing
- Experience with stream processing frameworks
- Familiarity with NoSQL databases
- Expertise in cloud-based big data solutions
- Understanding of data visualization techniques
- Knowledge of emerging big data technologies
YOUR FOREVER CAREER STARTS HERE
Are you looking for more than just a job? Join a company where employees are treated like family, and your career is built to last. We are a growing small business and a trusted federal contractor offering full scope consulting services in information technology, cybersecurity, and analyst workforce development.
At our company, you come first. We're committed to creating an environment where you'll thrive professionally and personally. We provide meaningful, challenging work using cutting-edge technologies while investing in your growth and success. With direct access to company leadership, a laid-back and inclusive atmosphere, and exceptional work-life balance, you'll feel valued every day.
We also believe in taking care of our family - both yours and ours. Our benefits are phenomenal, family-friendly, and designed with your well-being in mind. From employee and family events to career-long support, we create a community you'll never want to leave.
Ready to make your next move the best one? Join us and experience the difference.
BENEFITS
- Excellent Salaries
- Flexible Work Schedule
- Cafeteria Style Benefits
- 10% - 401k Matching (Vested Immediately)
- Additional 401k Profit Sharing
- 30 days Paid Leave/Holiday (No Use or Lose!)
- The day off for your birthday
- Medical/Dental/Vision - 100% employee coverage. ($1200 allowance - or a bonus)
- HSA/FSA
- AFLAC
- Long Term/Short Term Disability - 100% employee coverage. No cost to you.
- Life Insurance - 100% employee coverage. No cost to you.
- Additional Discretionary Life Insurance
- Paid Training
- No long, wordy reviews with tons of paperwork!
- Referral bonus program with recurring annual payments
HOW TO APPLY
Email us at or apply today:
Want to see what our employees think? Click here .
EQUAL OPPORTUNITY EMPLOYER STATEMENT
Cymertek is proud to be an Equal Opportunity Employer committed to fostering an inclusive and diverse workplace. We embrace and celebrate differences in our employees, recognizing that a diverse workforce enhances our creativity, innovation, and overall success. At Cymertek, employment decisions are made based on merit, qualifications, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by applicable laws. We believe in creating an environment where all individuals are treated with respect and dignity, and where opportunities for professional growth and advancement are accessible to everyone, regardless of background or identity.
View Now
5
Big Data Engineer
80161 Littleton, Colorado
EchoStar
Posted 2 days ago
Job Viewed
Job Description
Company Summary:
EchoStar is reimagining the future of connectivity. Our business reach spans satellite television service, live-streaming and on-demand programming, smart home installation services, mobile plans and products.
Today, our brands include Boost Mobile, DISH TV, Gen Mobile, Hughes and Sling TV.
Our Technology teams challenge the status quo and reimagine capabilities across industries. Whether through research and development, technology innovation or solution engineering, our people play vital roles in connecting consumers with the products and platforms of tomorrow.
Job Duties and Responsibilities:Candidates must be willing to participate in at least one in-person interview, which may include a live whiteboarding or technical assessment session.
As a Big Data Engineer on our 5G Network Analytics team, you will be responsible for designing, building and managing data pipelines specifically tailored for artificial intelligence (AI) models.
Priorities include ensuring high-quality data is readily available for training and deployment, data cleaning, transformation, integration, quality checks, and collaborating with AI engineers to optimize model performance.
Key responsibilities of an AI data engineer:
- Design and implement robust data pipelines to extract, transform, and load (ETL) data from various sources, optimizing for efficient AI model training.
- Gather and understand data requirements, create and maintain automated ETL processes with special focus on data flow, error recovery, and exception handling and reporting
- Support data and cloud transformation initiatives
- Support our software engineers and data scientists
- Understand the latest technologies in a rapidly innovative marketplace
- Ability to work independently and with a team with all stakeholders across the organization to deliver enhanced functionality
Skills, Experience and Requirements:
Education and Experience:
- Bachelor's degree in computer science, or similar technical field
- Minimum 5 years of experience in Big Data Engineering/Data Analysis
Preferred Skills and Qualifications:
- Proficiency in Python, SQL and Apache Spark
- AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
- Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
- Advanced SQL using Hive/Impala framework including SQL performance tuning
- Expertise in Hadoop, and other distributed computing frameworks
- ElasticSearch (OpenSearch) and Kibana Dashboards
- Resource management frameworks such as Yarn or Mesos.
- Physical table design in Big Data environment
- External job schedulers such as autosys, AWS data pipeline, airflow etc.
- Experience working in Key/Value data store such as Hbase
Benefits:
We offer versatile health perks, including flexible spending accounts, HSA, a 401(k) Plan with company match, ESPP, career opportunities, and a flexible time away plan; all benefits can be viewed here: DISH Benefits.
The base pay range shown is a guideline. Individual total compensation will vary based on factors such as qualifications, skill level, and competencies; compensation is based on the role's location and is subject to change based on work location. Candidates need to successfully complete a pre-employment screen, which may include a drug test and DMV check.
The posting will be active for a minimum of 3 days. The active posting will continue to extend by 3 days until the position is filled.
Salary Range:USD $96250.00 - $137500.00 / Year
View Now
Be The First To Know
About the latest Big data Jobs in United States !
6
Big data Engineer
85003 Phoenix, Arizona
Syntricate Technologies
Posted 2 days ago
Job Viewed
Job Description
Required Skills:
- Big Data Engineer with mapreduce , spark , hive , sql skillset
- Expert in SQL and Data warehousing concepts.
- Hands-on experience with public cloud data warehouse (GCP, Azure, AWS).
- GCP certification will be very good to have.
- MapR experience is must
- Strong Hands on experience with one or more programming languages ( Python or Java).
- Hands-on expertise with application design and software development in Big Data (Spark(Pyspark), HIVE).
- Experience with CICD pipelines, Automated test frameworks, DevOps and source code management tools (XLR, Jenkins, Git, Maven).
- Strong communication and analytical skills including effective presentation skills.
- Familiarity with Agile & scrum ceremonies. "
View Now
7
BIG Data Engineer
45208 Cincinnati, Ohio
Saxon Global
Posted 2 days ago
Job Viewed
Job Description
Title: Data Engineer
Rate:70/hr. on C2C
Visa: US Citizen or GC Holder only, no other visas will work for this role.
Location: Local to Cincinnati, OH within 60 miles - they will be going into the office 2-3 times per week on a hybrid schedule.
Duration: 8 Months
This is a proactive role, we're looking for data engineers with 10 - 20 years of experience, they need to have heavy Azure experience that includes Data Lakes, Azure data factory, azure databricks.
Not looking for a candidate with AWS Data bricks experience, this is a true azure data engineer - need to have 4+ years with that azure stack.
Must Haves:
Rate:70/hr. on C2C
Visa: US Citizen or GC Holder only, no other visas will work for this role.
Location: Local to Cincinnati, OH within 60 miles - they will be going into the office 2-3 times per week on a hybrid schedule.
Duration: 8 Months
This is a proactive role, we're looking for data engineers with 10 - 20 years of experience, they need to have heavy Azure experience that includes Data Lakes, Azure data factory, azure databricks.
Not looking for a candidate with AWS Data bricks experience, this is a true azure data engineer - need to have 4+ years with that azure stack.
Must Haves:
- Any experience with Databricks (including Delta/Delta live pipeline implementation, Databricks asset bundles, etc)
- Any experience with Python, Spark and SQL
- Any experience with Azure Data Platform stack: Azure Data Lake, Data Factory ,Storage containers etc
- Any experience with Databricks Unity Catalog
- Any experience with Github (including CI/CD implementation, Github actions etc)
- Any experience with Terraform
- Any experience with streaming technologies like Kafka, IBM MQ and EventHub
- Any experience with data science solutions or platforms
- Any experience with a variety of SQL, NoSQL and Big Data Platforms
- Any experience building solutions using elastic architectures (preferably Microsoft Azure and Google Cloud Platform)
View Now
8
Big Data Engineer
19087 Wayne, Pennsylvania
RIT Solutions, Inc.
Posted 2 days ago
Job Viewed
Job Description
Big Data Engineer
Client: Vanguard
Location: Malvern, PA (3 days onsite) - need to be onsite day one
Duration: 1 year
Video Interview is okay
Responsibilities
•Provides advanced level IT technical lead services and direction for software, middleware, or hardware projects on a single platform. Provides technical expertise and completes complex development, design, implementation, architecture design specification, and maintenance activities.
•Ensures the viability of IT deliverables.
•Communicates with key stakeholders on project issues and implications. Evaluates the impacts of change requests on technologies.
•Maintains current knowledge of IT development methodology, architecture design, and technical standards.
•Writes documentation, including technical standards and processes.
•Identifies opportunities for continuous quality improvement of technical standards, methodologies, and technologies.
•May participate in design, code, and test inspections throughout product life cycle to contribute technical expertise and to identify issues. Presents technical status and issues at milestone reviews.
Qualifications
•Python, AWS, Data Analytics, Spark, Infrastructure as Code, Docker, SQL, Big Data, and Bitbucket, Lambda, GIT, EMR, Glue, S3, RDS, DynamoDB, Cloud formation, Kinesis, Athena -
•Must have worked in AWS environment
Client: Vanguard
Location: Malvern, PA (3 days onsite) - need to be onsite day one
Duration: 1 year
Video Interview is okay
Responsibilities
•Provides advanced level IT technical lead services and direction for software, middleware, or hardware projects on a single platform. Provides technical expertise and completes complex development, design, implementation, architecture design specification, and maintenance activities.
•Ensures the viability of IT deliverables.
•Communicates with key stakeholders on project issues and implications. Evaluates the impacts of change requests on technologies.
•Maintains current knowledge of IT development methodology, architecture design, and technical standards.
•Writes documentation, including technical standards and processes.
•Identifies opportunities for continuous quality improvement of technical standards, methodologies, and technologies.
•May participate in design, code, and test inspections throughout product life cycle to contribute technical expertise and to identify issues. Presents technical status and issues at milestone reviews.
Qualifications
•Python, AWS, Data Analytics, Spark, Infrastructure as Code, Docker, SQL, Big Data, and Bitbucket, Lambda, GIT, EMR, Glue, S3, RDS, DynamoDB, Cloud formation, Kinesis, Athena -
•Must have worked in AWS environment
View Now
9