Data Engineer II at Cargill
Skip to main content

Data Engineer II

Apply Now
Job ID 225649 Date posted 11/24/2022 Location : Bengaluru, India

Job Purpose and Impact

The Data Engineer will treat data as an asset to design, build and execute high performance and data centric solutions by using the comprehensive big data capabilities for the company's data platform environment. In this role, you will build and optimize data products to bring data and analytics products and solutions to businesses. You will contribute to design of data structures and pipelines to collect data and design and implement data transformations, combinations, or aggregations. You will help build data streams and APIs to make data more consumable.

Key Accountabilities

· Collaborate with businesses and other stakeholders to participate in product or solution designs.
· Develop robust, scalable, and sustainable data products or solutions utilizing cloud-based technologies.

· Provide moderately complex technical support through all phases of product or solution life cycle.
· Perform data analysis, handle data modeling, and configure and develop data pipelines to move and optimize data assets.
· Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.
· Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
· Other duties as assigned

Qualifications

· Bachelor’s degree in a related field or equivalent experience
· Minimum of two years of related work experience

· Experience with data modeling, data warehousing & ETL processes and analytical tools

· Experience with Hadoop-based analytics, preferably Cloudera

· Experience building Kafka or Apache Pulsar streaming solutions

· Experience with API frameworks, gateways, and management

· Other minimum qualifications may apply

PREFERRED QUALIFICATIONS

· Proficiency in programming languages such as Java, Python, Scala, C#, Golang

· Experience with SQL/database and NoSQL backends

· Experience with Unix shell scripting, reporting and data analytics

· Experience with API development and integration

· Experience with data pipelining and performance optimization

· Experience working with various data sources, cloud-based, cross-application integrations

· Experience with Apache Spark, Big data analytics, Data Architecture, and Machine learning

· Experience developing software using agile methodologies such as Scrum and/or Kanban

Apply Now

Linkedin Job Matcher

Find where you fit in at Cargill. Log in to connect your LinkedIn profile and we’ll use your skills and experience to search the jobs that might be right for you.

Find Your Match

Sustainable
Cocoa

The Cargill Cocoa Promise is committed to securing a thriving cocoa sector for generations.

Learn More (Sustainable Coco)

Diversity,
Equity
& Inclusion

Our inclusive culture helps us shape the future of the world.

Learn More (Inclusion & Diversity)

Life at
Cargill

Discover how you can achieve your higher purpose with a career at Cargill.

Learn More (Life at Cargill)

View All of Our Available Opportunities

Thrive