17,909 Data Engineering Expert jobs in the United States

Job Description

As an ETL Developer, you will play a key role in designing, developing and supporting new and existing BI solutions for our users. The ETL Developer's primary contribution to the team involves transforming data into meaningful and accurate information which the business can consume.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• Custom SQL coding

• Terradata

• Redshift - Data Cleansing null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to

Job Title : ETL DEVELOPER

Location : 2 Montgomery Street, Jersey City, New Jersey

Job Type : Contract

Duration : 2+ Years

Work schedule : Normal business hours Monday-Friday 8-5

Pay Rate : $50 to $60 per hour

DESCRIPTION OF WORK (SCOPE OF WORK)

ERAD currently hosts Cognos and Microsoft Power Platform technologies to provide data, reporting and application development to various departments in an Agency. It is anticipated that this platform will be exploited to a much greater extent in the near future to address all aspects of corporate reporting needs and application development which enables the organization to make decisions that achieve better outcomes, flexible deployment options, and to enable to easily scale analytics to meet changing business needs.

The successful candidate may work independently as well as with both consultant and staff resources of different units and departments throughout the Agency under the direction of project manager to deliver work projects including but not limited to

JOB RESPONSIBILITIES:

• New development: Working with PA technical manager, responsible for understanding and documenting business requirements, providing project plans for new implementation, develop, test and deploy solutions to prod environment following PA processes for tracking user requirements, project development status and testing and deploying solutions following change/release management process.
• Systems Testing and Deployment – Responsible for unit and system integration testing, coordinating with business users for user acceptance testing and getting sign off from business users to implement solutions in the production for any new enhancements or development following PA’s change/release management process.
• Systems Support – Provide maintenance, enhancements and support of platform making sure the stability of applications is maintained by resolving any data issues, user help tickets in timely manner and provide on-call availability for off-hour problem resolution.
• Environment Support - Maintenance of Non-prod and Prod Cognos environments making sure the stability of these environments is always maintained by applying any required patching and upgrades as required.
• System administration - Provide system administration for installation and configurations of different components of Cognos platform, upgrades and responsible to maintain and establish user accounts, security profiles, controlling access to applications and reports following the process.
• Troubleshooting and Problem Management and Resolution - Logging, documenting, tracking and resolving system problems while ensuring ongoing data integrity with any and all interfaces and/or systems.
• Disaster Recovery Support – Defining, in conjunction with the Port Authority, the scope of periodic disaster recovery tests. Coordinating with other Port Authority staff and third parties to ensure all required tasks are covered for these tests.
• Documentation and Training - Responsible for providing all documentation needed for the continued operation and management of the system and for any new implementations that is accurate and available and in compliance with PA Standards. Provide training to end users on any new functionality of the application or platform by providing user guides.

MINIMUM EXPERIENCE AND QUALIFICATIONS:

• 8+ years of experience in designing, development, testing, and support of Data Warehouse and ETL processes as needed.
• Strong experience using SQL Server Integration Services (SSIS), SSAS and SSRS for analysis and report generation.
• Proficient in writing complex T-SQL Queries, Store Procedures, Views and ETL in re-designing Databases/Data warehouses using SQL server, SSIS and any custom scripts.
• Knowledge of working in Data platforms development using Azure SQL database, Azure Data Factory, Azure Storage, Azure Pipelines, Azure IaaS/PaaS related to database.
• Knowledge of or working experience with Cognos BI environment or other business Intelligence tool set such as Power BI or tableaus preferred.
• Experience in maintaining and monitoring ETL jobs by making sure that jobs are completed in a timely manner.
• Experience working with reporting and DBA teams for any query performance tuning and optimization as required.
• Ability to act independently to resolve issues, excellent communication and interpersonal skills, strong critical & analytic thinking.
• Bachelor's degree in computer science/engineering or related fields
• Any certification in related technologies is preferred.

ETL Developer

Category: Software Development/ Engineering

Main location: United States, Virginia, Fairfax

Position ID: J0625-1177

Employment Type: Full Time

Position Description:

CGI Federal is seeking a motivated and customer-oriented professional to support a large federal client. This role involves designing, implementing, and managing ETL processes and data integration to generate valuable business insights.

This position is located in our Fairfax, VA office; however, a hybrid working model is acceptable.

Your future duties and responsibilities:

Design and implement ETL processes to extract data from various sources, transform it according to business requirements, and load it into target databases or data warehouses.

Develop and maintain ETL scripts, stored procedures, and functions.

Data Integration and Management:

Generate new business insights through data extraction, storage, transformation, analysis, and visualization of diverse data sets.

Analyze data using data mining, machine learning, and statistical algorithms available in COTS tools (e.g., SAS, SPSS, and Oracle); build analytical solutions using programming languages (e.g., R, Python, SAS), and programming libraries (e.g., Python SciKit, R Caret, PostgreSQL MADlib, Apache Spark MLlib).

Ensure data integrity, consistency, and quality throughout the ETL process.

Collect and transform structured, unstructured, relational, and NoSQL data using ETL and ELT tools, as well as develop custom code using programming languages. Understand and use distributed methods (e.g., MapReduce) that scale to multi-Terabyte sized data collections.

Interpret and evaluate the accuracy of results through iterative, agile methods.

Apply data discovery and data visualization tools (e.g., Tableau, Trifacta) to develop compelling, actionable, and useful data stories.

Work closely with data SMEs, business, and management to prioritize business and information needs.

Required qualifications to be successful in this role:

8+ years of relevant experience.

Experience working directly on a data science team.

Experience with tools, including object-oriented programming (Python, Java), computational analysis tools (R, MATLAB), and associated data science libraries (scikit-learn).

Proficiency in data science methods related to data architecture, data munging, data and feature engineering, and predictive analytics.

Experience creating meaningful data visualizations and interactive dashboards using platforms such as Tableau, Qlik, Power BI, RShiny, plotly, and d3.js to communicate findings and relate them back to how your insights create business impact.

Experience with cloud-based ETL solutions (e.g., AWS Glue, Azure Data Factory).

Knowledge of Big Data technologies (e.g., Hadoop, Spark).

Certification in relevant ETL or data integration technologies.

Bachelor's Degree in data science, mathematics, statistics, economics, computer science, engineering, or other related business or quantitative discipline.

Ability to obtain and maintain a Public Trust.

CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and license and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $85,800.00 - $209,100.00.

CGI Federal's benefits are offered to eligible professionals on their first day of employment to include:

-Competitive compensation

-Comprehensive insurance options

-Matching contributions through the 401(k) plan and the share purchase plan

-Paid time off for vacation, holidays, and sick time

-Paid parental leave

-Learning opportunities and tuition assistance

-Wellness and Well-being programs

Due to the nature of this government contract, US Citizenship is required.

#CGIFederalJob

#LI-DD1

Skills:

• Adobe Spark

• Hadoop Ecosystem (HDFS)

What you can expect from us:

Together, as owners, let's turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because.

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.

Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team-one of the largest IT and business consulting services firms in the world.

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business.

CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.

We make it easy to translate military experience and skills! Clickhere ( to be directed to our site that is dedicated to veterans and transitioning service members.

All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.

CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.

• Adobe Spark
• Hadoop Ecosystem (HDFS)

Provide a short description of the Position:This position will design and implement software solutions and ensure current and new technologies are effectively integrated to fulfill the business needs.

Provide a list of the day to day tasks to be performed by the Selected Candidate:This individual will be expected to participate in the following activities: • Implementing Integrated Justice Portal standards related to database development • Utilize uses cases, business requirements documents, and flow diagrams to design complex relational databases • Follow all phases of the Software Development Life Cycle (SDLC) - analysis, design, testing, implementation, maintenance • Follow and contribute to agency standards and utilize industry best practices • Develop queries and stored procedures for data extraction, using SQL against databases; write complex efficient SQL • Perform ongoing support for production applications - including system monitoring, processing, user support, and performance tuning • Create, maintain, and deploy batch processes to support Gun Safety business processes • Research emerging technologies to improve current processes • Create data dictionaries and business glossaries

Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

Job Title: ETL Developer Location: Wright Patterson AFB Clearance: Secret Salary: 100-130k Company Summary: Our client is a proven leader in information technology, innovative strategic technical planning, and program management offering a professional level of expertise to their partners. Having been around for over five years our client provides the resources necessary for their team members to excel and reach their career goals in the IT industry. Position Summary: This Position requires the following specific technical and professional background: The ideal candidate will have a minimum of 5+ years of similar Data Experience Job Responsibilities: Develop and implement ETL solutions, updating the architecture of our databases as necessary. Develop and update SQL queries and scripts The ideal candidate will possess the following: 5+ years of Similar ETL experience Bachelors in computer science or related field Anistar PAYS YOU for referrals! If you know any qualified job seekers looking for work, we want to talk with them! Call us to find out more information regarding our referral placement program!About Us: At Anistar Technologies, we connect individuals from a variety of industries with respected companies, both nationally and internationally. Each day, our Recruiters are presenting our clients with talented industry professionals for their most in-demand positions. To accomplish this, the Anistar staffing team will invest the time to understand your goals, work experiences, and career objectives. To search for other exciting opportunities in your area, visit our website at .Anistar Technologies is an Equal Opportunity Employer and is dedicated to fostering diversity in the workplace.Interested Candidates, click "Apply", or contact the Anistar office at the number listed below. Contact: Anistar Technologies PH: ( Fax:

• Design, develop, and deploy ETL processes Oracle Data Integrator (ODI) and OCI-DI.
• Implement data integration solutions using OIC, connecting diverse data sources like cloud databases, on-premises systems, REST APIs, and flat files.
• Develop and optimize SQL and PL/SQL scripts for data extraction, transformation, and loading.
• Assist with migration of on-premises ETL solutions to cloud-based platforms as needed.
• Monitor and troubleshoot ODI jobs, performance tuning of ETL processes, SQL queries, and PL/SQL procedures.
• Prepare and maintain detailed technical documentation for developed solutions.

• Minimum of 6 years of related experience
• Bachelor's degree preferred or equivalent experience

• Strong hands-on experience with Oracle Data Integrator (ODI) development and administration.
• Proficiency in SQL and PL/SQL for complex data manipulation and query optimization.
• Experience deploying and managing ETL solutions on OCI PaaS/IaaS environments.
• Deep understanding of ETL processes, data warehousing concepts, and cloud data integration.
• Experience in integrating on-premise and cloud-based data sources.
• Strong problem-solving and debugging skills.
• Good communication and teamwork abilities.

• Develop and implement ETL solutions, updating the architecture of our databases as necessary.
• Develop and update SQL queries and scripts

• 5+ years of Similar ETL experience
• Bachelors in computer science or related field

Responsible for coding, modifying, debugging, and documenting data and analytics applications that best support Office Of Internal Audit (OIA) business requirements.