8,975 Data Engineer jobs in the United States

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop and optimize big data solutions using Spark, Hadoop, and Kafka.
• Implement and manage data warehousing solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists and analysts to meet their data needs.
• Develop and maintain data models for various analytical purposes.
• Automate data workflows and implement monitoring solutions.
• Troubleshoot and resolve complex data engineering issues.

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field; Master's preferred.
• 5+ years of experience in data engineering or a similar role.
• Proven experience with big data technologies (Spark, Hadoop, Kafka).
• Strong proficiency in SQL and NoSQL databases.
• Experience with cloud platforms (AWS, Azure, GCP).
• Proficient in Python or Scala for data processing.
• Understanding of data warehousing principles and best practices.
• Excellent problem-solving and communication skills.
• Ability to work independently and effectively in a remote team.

• Design, develop, and optimize robust ETL/ELT pipelines for ingesting and transforming data from various sources into data warehouses and data lakes.
• Build and maintain scalable data infrastructure using big data technologies such as Spark, Hadoop, and Kafka.
• Ensure data quality, consistency, and accuracy across all data platforms.
• Develop and implement data models that support analytical and reporting needs.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Monitor and troubleshoot data pipelines, identifying and resolving performance bottlenecks.
• Implement data governance and security best practices.
• Automate data processes and workflows.
• Stay current with emerging data engineering technologies and trends.
• Provide technical guidance and mentorship to junior team members.

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong programming skills in Python, Java, or Scala.
• Hands-on experience with big data technologies (e.g., Apache Spark, Hadoop ecosystem, Kafka).
• Experience with cloud data platforms (e.g., AWS Redshift, Azure Data Lake, Google BigQuery).
• Familiarity with data warehousing concepts and Kimball/Inmon methodologies.
• Experience with workflow management tools like Apache Airflow.
• Understanding of data modeling techniques and best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to work effectively in a hybrid work environment, balancing remote and on-site collaboration in **Oklahoma City, Oklahoma, US**.

Solicitation Reference Number 302CSD2504 Customer Name Office of the Attorney General of Texas Category Data/Database Administration Customer Entity Name ttorney General, Office of the Title Data Scientist (Big Data Engineer)

Level Data Scientist (Big Data Engineer) 2 Estimated Hours 1,000 SSR Status Posted Number of Positions 2 Status New # of Resumes Allowed 1 Candidates Submitted Full/Part Time Full Time

IT STAFFING SERVICES SOLICITATION UNDER
DEPARTMENT OF INFORMATION RESOURCES
IT STAFF AUGMENTATION CONTRACT (ITSAC)
Solicitation Reference Number: 302CSD2504 Working Title: Data Scientist Title/Level: Data Scientist (Big Data Engineer) 2 Category: Data/Database Administration Full Time

I. DESCRIPTION OF SERVICES

Office of the Attorney General of Texas requires the services of 2 Data Scientist (Big Data Engineer) 2 , hereafter referred to as Candidate(s), who meets the general qualifications of Data Scientist (Big Data Engineer) 2, Data/Database Administration and the specifications outlined in this document for the Office of the Attorney General of Texas .

ll work products resulting from the project shall be considered "works made for hire " and are the property of the Office of the Attorney General of Texas and may include pre-selection requirements that potential Vendors (and their Candidates) submit to and satisfy criminal background checks as authorized by Texas law. Office of the Attorney General of Texas will pay no fees for interviews or discussions, which occur during the process of selecting a Candidate(s).

The Office of the Attorney General's Chief Data Office (CDO) is seeking a dynamic and visionary Data Scientist to join our team and support our System Modernization efforts for the Child Support Division. This individual must be able to work in a heavily technical environment, preparing and optimizing data for Snowflake and utilizing SAS Viya to build comprehensive federal and state reports. You will play a pivotal role in transforming, analyzing, and leveraging our data assets to drive strategic initiatives and business outcomes. You must be comfortable analyzing data, developing predictive modeling algorithms, and can communicate your findings through visualizations enabling the discovery of solutions to business problems. As a Data Scientist your role will be impactful, visible, and rewarding.

Responsibilities will include:
Data Conversion and Reporting Support for System Modernization Efforts Data Transformation and Integration : Prepare and optimize data for migration to Snowflake and SAS Viya platforms, ensuring seamless integration and functionality by creating data transformation processes using ETL, SQL, Python, and R. Develop Federal and State Reports : Build comprehensive reports that meet federal and state requirements using Snowflake and SAS Viya, ensuring accuracy and compliance. Scrum Team Collaboration : Work as a member of an agile team to deliver new features and functions, delivering best-in-class value-based technology solutions. Data Quality Management: Develop and implement databases, ETL processes, data collection systems, and data quality strategies that optimize statistical efficiency, accuracy, and quality. Problem Examination and Resolution : Examine problems within the Data Intelligence space using ETL, Lambda, and Glue, and implement necessary changes to ensure data quality improvement. Data Analytics and Insights: Utilize advanced data analytics techniques to support strategic decision-making, ensuring data integrity, quality, and timeliness of results.

The above job description and requirements are general in nature and may be subject to change based on the specific needs and requirements of the organization and project.

II. CANDIDATE SKILLS AND QUALIFICATIONS Minimum Requirements:
Candidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity. Years Required/Preferred Experience 4 Required Proven experience in data conversion and report building using Snowflake and SAS Viya. 4 Required Demonstrated experience in data transformation processes using ETL, SQL, Python, and R. 4 Required Experience working with data analytics and business intelligence tools. 4 Required Experience working in a Scrum or Agile development environment. 4 Required Proficiency in ETL processes and tools such as AWS Glue and Lambda. 4 Required Strong knowledge of database management and data warehousing concepts. 4 Required Expertise in SQL for data querying and manipulation. 4 Required Proven experience in data conversion and report building using Snowflake and SAS Viya. 4 Required Demonstrated experience in data transformation processes using ETL, SQL, Python, and R. 4 Required Experience working with data analytics and business intelligence tools. 4 Required Experience working in a Scrum or Agile development environment. 4 Required Proficiency in ETL processes and tools such as AWS Glue and Lambda.
III. TERMS OF SERVICE

Services are expected to start 11/12/2024 and are expected to complete by 08/31/2025 . Total estimated hours per Candidate shall not exceed 1000 hours. This service may be amended, renewed, and/or extended providing both parties agree to do so in writing.
IV. WORK HOURS AND LOCATION

Services shall be provided during normal business hours unless otherwise coordinated through the Office of the Attorney General of Texas . Normal business hours are Monday through Friday from 8:00 AM to 5:00 PM , excluding State holidays when the agency is closed.

The primary work location(s) will be at OAG State Office located at 5500 E. Oltorf St, Austin, TX 78741 . The working position is Telework . Any and all travel, per diem, parking, and/or living expenses shall be at the Candidate's and/or Vendor's expense. Office of the Attorney General of Texas will provide pre-approved, written authorization for travel for any services to be performed away from the primary work location(s). Pre-approved travel expenses are limited to the rates and comply with the rules prescribed by the State of Texas for travel by its classified employees, including any requirement for original receipts.

The Candidate(s) may be required to work outside the normal business hours on weekends, evenings and holidays, as requested. Payment for work over 40 hours will be at the hourly rate quoted and must be coordinated and pre-approved through Office of the Attorney General of Texas .
V. OTHER SPECIAL REQUIREMENTS

The candidate(s) will be subject to a criminal background check that includes a DPS/FBI background check and fingerprinting.

Solicitation Reference Number


Customer Name
Texas Health and Human Services Commission

Category
Data/Database Administration

Customer Entity Name
Health and Human Services Commission

Title
Data Scientist (Big Data Engineer)

Level
Specialist

Posted Date
6/21/2024

Estimated Hours
360

SSR Status
Posted

Number of Positions
2

Status
New

# of Resumes Allowed
1

Candidates Submitted
Full/Part Time
Full Time

IT STAFFING SERVICES SOLICITATION UNDER
DEPARTMENT OF INFORMATION RESOURCES
IT STAFF AUGMENTATION CONTRACT (ITSAC)
RFO DIR-CPO-TMP-445
Solicitation Reference Number: Working Title: Data Scientist (Big Data Engineer) Specialist Title/Level: Data Scientist (Big Data Engineer) Specialist Category: Data/Database Administration Full Time

I. DESCRIPTION OF SERVICES

Texas Health and Human Services Commission requires the services of 2 Data Scientist (Big Data Engineer) Specialist , hereafter referred to as Candidate(s), who meets the general qualifications of Data Scientist (Big Data Engineer) Specialist, Data/Database Administration and the specifications outlined in this document for the Texas Health and Human Services Commission .

All work products resulting from the project shall be considered "works made for hire " and are the property of the Texas Health and Human Services Commission and may include pre-selection requirements that potential Vendors (and their Candidates) submit to and satisfy criminal background checks as authorized by Texas law. Texas Health and Human Services Commission will pay no fees for interviews or discussions, which occur during the process of selecting a Candidate(s).

Assessment, analysis, planning, remediation, and fraud analytics road mapping services. Inventory and evaluation of systems, data, processes, and solutions.

One position will be part time for 72 hours and the other one will be full time with the full 360 hours.

II. CANDIDATE SKILLS AND QUALIFICATIONS
Minimum Requirements:
Candidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity. Years Required/Preferred Experience 10 Required Big Data, AI/Client, Data Science workflows and automation

III. TERMS OF SERVICE

Services are expected to start 07/22/2024 and are expected to complete by 08/30/2024 . Total estimated hours per Candidate shall not exceed 360 hours. This service may be amended, renewed, and/or extended providing both parties agree to do so in writing.

IV. WORK HOURS AND LOCATION

Services shall be provided during normal business hours unless otherwise coordinated through the Texas Health and Human Services Commission . Normal business hours are Monday through Friday from 8:00 AM to 5:00 PM , excluding State holidays when the agency is closed.

The primary work location(s) will be at 4601 Guadalupe, Austin, Texas 78751 . The working position is Telework . Any and all travel, per diem, parking, and/or living expenses shall be at the Candidate's and/or Vendor's expense. Texas Health and Human Services Commission will provide pre-approved, written authorization for travel for any services to be performed away from the primary work location(s). Pre-approved travel expenses are limited to the rates and comply with the rules prescribed by the State of Texas for travel by its classified employees, including any requirement for original receipts.

The Candidate(s) may be required to work outside the normal business hours on weekends, evenings and holidays, as requested. Payment for work over 40 hours will be at the hourly rate quoted and must be coordinated and pre-approved through Texas Health and Human Services Commission .

V. OTHER SPECIAL REQUIREMENTS
TERM OF SERVICE (Required)

Services are expected to start on or around July 22, 2024 and are expected to completed by August 31, 2024. Total estimated hours per Candidate shall not exceed 360 hours for FY24. This service may be amended, renewed, and/or extended providing both parties agree to do so in writing.

WORK HOURS AND LOCATION (Required)

A) Services shall be provided during normal business hours unless otherwise coordinated through the Agency. Normal business hours are Monday through Friday from 8:00 a.m. through 5:00 p.m., excluding Texas state holidays when the agency is closed.

B) The primary work location will be 4601 Guadalupe, Austin, Texas 78751.

Position will be remote. Program will allow candidates who are within the state (Any location within the State of Texas).

C) Any and all travel, per diem, parking, and/or living expenses shall be at the worker's and/or Vendor's expense.

D) The worker may be required to work remotely at HHSC discretion, up to 100 percent of the time.

E) The worker may be required to work outside the normal business hours on weekends, evenings and holidays, as requested. Payment for work over 40 hours will be at the hourly rate quoted and must be coordinated and pre-approved through the Agency.

OTHER SPECIAL REQUIREMENTS

Interviews will be conducted: (check all that apply)

By Phone

In person

Through Microsoft Teams

IMPORTANT INFORMATION

vendor's submission of a candidate may be disqualified if :

• The vendor fails to add the candidate to competitive solicitation, or RFR, in the DIR ITSAC Portal.
• Another vendor submits the same candidate for the same competitive solicitation, also known as a request of resume (RFR).
• The vendor submits more than one candidate for the same competitive solicitation, or RFR.
• The vendor submits a candidate after the response period for a competitive solicitation, or RFR.
• The vendor fails to format the email subject line properly, when submitting a candidate for a competitive solicitation, or RFR:
  • Proper Formatting: Solicitation Number, Vendor Name, Candidate First and Last Name, Position Type and Level
  • Example: , Sanders Technologies, Jane Doe, Project Lead 3
• The vendor fails to follow any other instructions noted in the competitive solicitation, or RFR.