137 Data Mining jobs in Chicago

We specialize in Staffing, Consulting, Software Development, and Training along with IT services to small to medium size companies. AG's primary objective is to help companies maximize their IT resources and meet the ever-changing IT needs and challenges. In addition, AG offers enterprise resource planning and enterprise application integration, supply-chain management, e-commerce solutions, and B2B public exchanges and B2B process integration solutions. Our company provides application analysis, design, development and programming, software engineering, systems development, testing, integration, and implementation, and management consulting services to various clients – including governmental agencies and private companies – throughout the United States and India. We provide these services in multiple computing environments and use technologies such as client/server architecture, object-oriented programming languages and tools, distributed database management systems, state-of-the-art networking, and communications infrastructures. Our honest and realistic approach to recruiting dictates that AG does not entice or lure engineers from their employers. We represent only high caliber technical professionals who have committed to making a change required by career. Job Description Job Description: Big Data tester with work exp in Hadoop,Pig,Spark,Hive,Impala. Strong in SQL skills and Testing, Strong Unix/Python. If the candidates are from development background and not with testing skills, we are fine. #J-18808-Ljbffr

Posting Type

Hybrid

Job Overview

Job Description and Requirements

Your role in action

• Design and implement scalable performance improvements to the DDM and its supporting infrastructure.

• Build APIs and backend services that integrate with the DDM and support new use cases.

• Collaborate with product and engineering teams to define and execute modernization strategies.

• Drive improvements in system observability, reliability, and maintainability.

• Actively participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.

• Participate in code reviews for projects written by your team

• Focus on quality through comprehensive unit and integration testing

Your skills

• 4+ years of experience building commercial-grade systems in a SaaS or tech environment.

• Strong proficiency in C# or equivalent languages (Go, Java, Ruby) and design patterns.

• Deep understanding of relational and NoSQL databases, including schema design and performance tuning.

• Experience with microservices, container orchestration (Kubernetes), and CI/CD practices.

• Proven track record of designing and building APIs (REST, gRPC, GraphQL) and backend services.

• Experience abstracting direct OLTP data CRUD access via APIs is essential.

• Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations

• Leverages best practices and past experiences to mentor and improve the productivity of the team

We'd particularly love it if you have:

• Demonstrated proficiency with CosmosDB, CockroachDB, or Postgres.

• Familiarity with infrastructure-as-code and DevOps practices.

• Experience designing and maintaining ETL/ELT pipelines in cloud-native environments.

• Background in event-driven architectures or streaming systems.

• Experience with Domain Driven Design (DDD).

• Experience with Spark (PySpark or Scala) or DataFusion (Rust) and columnar table formats like (Delta or Iceberg).

Relativity is committed to competitive, fair, and equitable compensation practices.

This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.

The expected salary range for this role is between following values:

The final offered salary will be based on several factors, including but not limited to the candidate's depth of experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would not be typical, to allow for future meaningful salary growth in this position.

• Lead the collection, cleansing, and validation of large, complex datasets from various mining operational systems (e.g., production, maintenance, logistics, geological surveys).
• Design, develop, and deploy advanced analytical models (e.g., predictive maintenance, yield optimization, equipment performance, resource forecasting).
• Utilize statistical analysis, machine learning algorithms, and data visualization techniques to uncover patterns, trends, and actionable insights.
• Translate complex data findings into clear, concise reports and presentations for technical and non-technical stakeholders, including senior management.
• Collaborate with operational teams, engineers, and geologists to understand business challenges and define data requirements.
• Develop and maintain dashboards and reporting tools to monitor key performance indicators (KPIs) and provide real-time visibility into operations.
• Identify opportunities for process improvements and cost reductions through data-driven recommendations.
• Mentor and guide junior data analysts, fostering a culture of data literacy and analytical excellence.
• Stay current with emerging data science technologies, tools, and best practices relevant to the mining industry.
• Ensure data integrity and compliance with data governance policies.

• Bachelor's or Master's degree in Data Science, Statistics, Computer Science, Engineering, or a related quantitative field.
• Minimum of 7-10 years of experience in data analysis, business intelligence, or data science roles, with at least 3 years in a lead or senior capacity.
• Proven experience working with large datasets, ideally within an industrial, manufacturing, or heavy machinery context. Experience in mining is a significant advantage.
• Expert proficiency in SQL for data extraction and manipulation.
• Strong programming skills in Python or R for data analysis, modeling, and visualization.
• Experience with data visualization tools (e.g., Tableau, Power BI, Qlik Sense).
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark).
• Solid understanding of statistical modeling, machine learning concepts, and predictive analytics.
• Excellent problem-solving abilities, with a strong analytical mindset and attention to detail.
• Exceptional communication and presentation skills, with the ability to effectively convey complex analytical results to diverse audiences.
• Self-motivated, organized, and capable of managing multiple projects in a remote work environment.

This range is provided by Societe Generale. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $81,000.00/yr - $50,000.00/yr Reference 24000NBY Responsibilities Global Banking Technology & Operations (GBTO) delivers day-to-day services to Global Banking & Investor Solutions (GBIS) Business Units and their clients. With IT & Operations teams working side by side under the same leadership, the goal of GBTO is to meet the evolving needs of its clients and market requirements, as well as anticipate technological advances to accelerate and support the transformation of GBIS activities. GBTO is at the very heart of this technological and operational challenge. The Listed Derivatives Transactions Service Department is primarily engaged to provide IT solutions for the Equity Prime Services business line clients externally and internally. Working in partnership with Prime Service Front Office and Operations, we deliver innovative and robust solutions, with a desire to produce market leading solutions. As a Sr. Big Data Java Engineer, you will work in the development of our data lake streaming platform in Azure. As member of the Feature Team, you will work in autonomy, which includes the following development tasks: Architect, design and develop Kafka Stream based Java applications in Azure Architect, design and develop data pipelines for Big Data volume using Spark (Java) in Azure. Write high quality code in Java. Design, develop and deploy systems with scalability and resiliency in mind. Review code, offer improvements to design, process and help team improve. Work with distributed systems with huge volume of data Good working knowledge troubleshooting performance issue Support deconstruction of customer requests into detailed stories by interacting with the Product Owner Deliver working code that meets acceptance criteria as well as meets the definition of done at different levels Write code, deploy scripts, unit test, check code to source code repository, and monitor delivery pipeline activity to ensure product quality and consistency Conduct testing, deployment, and production activities of the team to ensure production stability, applying the guidelines provided by the chapter Engage in pair programming to write high quality code that’s easy to understand and support Write tests - very often before the associated code - at unit level with Junit, Mockito and in BDD style with Cucumber Attend backlog refinement and planning sessions to discuss and estimate (small, medium, large) upcoming stories Required Profile required Technical Skills: Must have experience with Java, Kafka Streams and Spark Good working knowledge of distributed systems. Must be comfortable with system design in designing Big Data systems for both batch and real time. Must have working experience with Spark jobs and troubleshooting performance issue. Must have working experience in dealing with high volume of data – batch and realtime processing. Cloud experience is must – AWS or Azure Sound knowledge of Spring Boot or another Java back-end framework, Kafka, Elastic Search, Kibana, & Kubernetes Strong experience with Cloud & Big Data technologies like Spark and Kafka Designing RESTful APIs and integrating third party RESTful APIs. Working familiarity with code revising and branding, ideally Git. Competencies: Comfortable working in agile methodologies, ideally Scrum. Experience with automated testing approaches - test driven development, unit testing, integration testing, and BDD testing. Exposure to continuous integration tools. Understanding of service-oriented architectures and message brokers. Strong analytical skills and problem-solving ability. Able to break down complex problems into simple manageable units, develop solutions for each unit, and integrate them back into the whole. Results oriented, able to set goals and priorities that maximize the use of resources available to consistently deliver quality results. Team-oriented, client-focused and open to different ideas/viewpoints. Self-awareness of own behavior and work style, as well as tolerant of different needs and viewpoints Experience Needed: 7+ years of experience working as Java Senior Programmer 3+ years of experience working in Spark, Kafka and cloud Educational Requirements: BS/master’s degree in computer science, Information Technology or relevant technical field. Business insight OUR CULTURE: At Societe Generale, we live by our 4 core values of commitment, responsibility, team spirit and innovation. We are engaged and demonstrate consideration for others. We act ethically and with courage. We focus our talent and energy on collective success. We experiment and propose new ideas. This way, we maximize our ability to serve client needs and anticipate market changes. Societe Generale is committed to strengthening bonds with colleagues, communities, and the world in which we live, because relationships are at the heart of how we operate. For more information about our Culture and Conduct initiatives, please visit this link ( D&I: Our Diversity & Inclusion Mission: Recruit, develop, advance, and retain a diverse workforce that is united in our efforts to enhance our competitive position and deliver innovative solutions to our clients. Our Diversity & Inclusion Vision: Engaged workforce that is demographically diverse in a way that reflects the communities in which we operate Inclusive culture and workplace that recognizes employees' unique needs and utilizes their diverse talents Engage our community and marketplace, and position the organization to meet the needs of all its clients For more information about our D&I initiatives, please visit this link ( HYBRID WORK ENVIRONMENT: For most positions, Societe Generale offers a hybrid work arrangement that offers employees the flexibility to work remotely, as well as on-site, in order to promote interaction and collaboration with colleagues while adhering to all SG standard protocols. Hybrid work arrangements vary based on business area. The applicable Business lines will determine and communicate the work arrangements that best meet their business needs. COMPENSATION & SALARY RANGE: Base salary range does not include overtime pay, bonus and/or other benefits, where applicable. Actual base salary offer will vary based on skills and experience. The role is eligible for an annual discretionary bonus and includes a competitive benefits package including 401(k) plan with company match, Medical/Dental/Vision, and other benefits for fertility, wellness, student loans and commuters. Diversity and Inclusion Societe Generale is an equal opportunity employer, and we are proud to make diversity a strength for our company. We are committed to recognizing and promoting the talents and achievements of our employees and staff, regardless of race, religion, color, national origin, sex, disability, age, gender, sexual orientation, and any other characteristic or status protected under applicable law. Seniority level Seniority level Not Applicable Employment type Employment type Full-time Job function Job function Engineering and Information Technology Industries Financial Services and Investment Banking Referrals increase your chances of interviewing at Societe Generale by 2x Get notified about new Big Data Developer jobs in Chicago, IL . Chicago, IL $100,000 00- 167,500.00 1 week ago Deerfield, IL 98,600.00- 157,500.00 1 month ago Deerfield, IL 98,600.00- 157,500.00 1 month ago Deerfield, IL 98,600.00- 157,500.00 1 month ago Chicago, IL 110,000.00- 150,000.00 5 days ago Software Engineer (Python), Data Platform Chicago, IL 165,000.00- 195,000.00 1 month ago Bedford Park, IL 109,200.00- 160,871.00 1 month ago Chicago, IL 150,000.00- 220,000.00 1 week ago Chicago, IL 99,600.00- 139,440.00 2 weeks ago Chicago, IL 115,000.00- 125,000.00 4 days ago Chicago, IL 175,000.00- 225,000.00 1 week ago Rosemont, IL 165,000.00- 175,000.00 6 days ago Rolling Meadows, IL 97,500.00- 190,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

A Few Words About UsIntegrated Resources, Inc is a premier staffing firm recognized as one of the tri-states most well-respected professional specialty firms. IRI has built its reputation on excellent service and integrity since its inception in 1996. Our mission centers on delivering only the best quality talent, the first time and every time. We provide quality resources in four specialty areas: Information Technology (IT), Clinical Research, Rehabilitation Therapy and Nursing. Job Description Duration: 6+ months Job Description: Job Overview: • The Data Transformation Program (DTP) - Building one integrated data eco system across Retail Banking, Retail Banking Finance and Credit Risk to manage and analyze customer data to inform our decision making, build stronger relationships with our customers and grow revenues by making the right offers, to the right customers, at the right time and in the right way. • Working within the Information Services team, the Project Manager will be responsible for owning, managing and reporting end to end deliverables for Data Foundation work stream across 6 markets (UK, HK, France, US, Canada and Mexico) Duties & Responsibilities: • Providing project management support to the GS IT management for DTP data foundation work stream • Managing and guiding a team to carry out detail project management activities effectively on a day to day – effectively tracking tasks and reporting progress • Build and manage end to end Project plans • Resource, budget management for IM work stream • Leading related calls and meetings to drive progression and problem resolution. • Stake-holder/relationship management to ensure that messages/updates are timely, objective, factual and consistent. • Adherence to programme governance at all times. • Support technical resources and others in the delivery ‘circle’ as/when needed. Skill, Experience & General information Required: • Excellent written and spoken communication skills with experience of successfully influencing others, negotiating effectively and winning over audiences with compelling and persuasive presentations • Proven experience and understanding of Big Data from a technical perspective. • Experience of operating in similar-sized organisations. • Good technical understanding ex Big Data, majoring on data and information services. Technical • Broad knowledge of Big Data tools and their capabilities • Good technical understanding of the following Big Data Technologies • Infrastructure, Data Quality and Governance • Data replication, streaming and extraction Focus • The ability to quickly understand the requirements of the task in hand, and drive a quality result first time and on time. • Delivery-focused with ability to pay attention to detail and ensure tasks are completed on time and to expectation. • Proven ability to prioritise workload effectively in line with priorities and multi-task where required. • Can do’ attitude - Willing to turn a hand to whatever task is required. Judgment • Skilled decision-maker – considered and timely especially when under pressure. • Able to review information and extract the important aspects quickly. • A successful track record of leading significant and complex business programmes, overcoming challenges to consistently meet/exceed objectives • Ability to build relationships by communicating, influencing and negotiating effectively with business heads, senior managers, third party consultants, technical experts across the whole department and business users. • Willingness to own work and problems and see through to completion and to use own initiative to resolve issues, whilst dealing with a diverse range of people. • Strong interpersonal skills, coupled with the ability to succeed within a matrix management structure and build and maintain global team relationships. Additional Key skills: • Banking systems experience so is able to understand the systems landscape • Experience supporting large, global, functional IT/Change Programmes within Banking. #J-18808-Ljbffr

Job Posting Date: May-03-2021 Job Title: Sr. Big Data / Data Management Consultants / Architects Preferable locations (Not mandatory): Scottsdale and Naperville We are looking for talented individuals to become part of our growing business and grow with us. The right person should have progressive experience of working on various technologies, databases, data management, data integration with Big Data technologies experience. An ideal person must have one or more of the skills on – Hadoop, Cloudera, Map R, Hortonworks, Spark, Storm, Oozie and exposure to Pig scripting, Hive, etc. Exposure or experience of working on Data warehouse, reporting and analytical projects is a key advantage. Exposure to working on various project management methodologies such as Waterfall and Agile is a plus. The role and compensation will depend upon the exposure to technology areas and implementation project experience. Education: BS/BA in Computer Science or related discipline required. Experience: Overall years of experience: Varies based on the role. Minimum 10 years of experience in the IT Industry. At least 10 years of technical experience with data management and with hands-on experience in one or more areas of Big Data. Experience with reporting and analytics tools is an advantage. Experience in Oracle DB, SQL Server, MySQL, NoSQL such as MongoDB with strong skills in SQL, PL/SQL, and Java. Knowledge, Skills, and Abilities: Candidates with exposure to Informatica, IBM, Oracle, Enterprise Service Bus , and working experience with multiple big data technology areas will be given a strong preference. Well organized and able to manage multiple projects in a fast-paced demanding environment. Attention to detail and quality; excellent problem-solving and communication skills. Ability and willingness to learn new tools and applications. Effective written and verbal communication skills with the ability to convey complex technical concepts to business users and management. Other Requirements: Ability to travel across the USA with short notice and willingness to travel to Canada. Travel requirement is 50 – 100% or relocate to client location for long-term assignments. This job may include the above job duties and is not an all-inclusive list of all job duties that may be required. Employees will be required to perform other related duties as assigned. Artha is an equal opportunity employer. Please send your updated profile to or . #J-18808-Ljbffr