This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept

checked This is a sample alert

Consultant — Data Engineer (AWS Big Data)

  • Full Time
  •  Hybrid - Bengaluru
  • 3 months
  • Project posted on: 23/04/2025
add_new View Project Details

Consultant — Data Engineer (AWS Big Data)

  • Information Technology
  • Software Development - web technologies
  • DBA/datawarehousing
  • Technology Operations and Support

Hybrid - Bengaluru

Full Time

3 months

 23/04/2025

Assignment Details

Our client, a leading global specialist in energy management and automation, is seeking Independent Data Engineers to work with current technologies used by IntelDS and in particular Apache Spark, Lambda & Step Functions, Glue Data Catalog, and RedShift on AWS environment.


Key Responsibilities:
 

 Design and develop new data ingestion patterns into IntelDS Raw and/or Unified data
layers based on the requirements and needs for connecting new data sources or for
building new data objects. Working in ingestion patterns allow to automate the data
pipelines.
 Participate to and apply DevSecOps practices by automating the integration and delivery
of data pipelines in a cloud environment. This can include the design and implementation
of end-to-end data integration tests and/or CICD pipelines.
 Analyse existing data models, identify and implement performance optimizations for data
ingestion and data consumption. The objective is to accelerate data availability within the
platform and to consumer applications.
 Support client applications in connecting and consuming data from the platform, and
ensure they follow our guidelines and best practices.
 Participate in the monitoring of the platform and debugging of detected issues and bugs.

Skills Required

Minimum of 3 years prior experience as data engineer with proven experience on Big Data and Data Lakes on a cloud environment.
Bachelor or Master degree in computer science or applied mathematics (or equivalent).

- Proven experience working with data pipelines / ETL / BI regardless of the technology.
- Proven experience working with AWS including at least 3 of: RedShift, S3, EMR, Cloud
Formation, DynamoDB, RDS, lambda.
- Big Data technologies and distributed systems: one of Spark, Presto or Hive.
- Python language: scripting and object oriented.
- Fluency in SQL for datawarehousing (RedShift in particular is a plus).
- Good undesrtanding on datawarehousing and Data modelling concepts
- Familiar with GIT, Linux, CI/CD pipelines is a plus.
- Strong systems/process orientation with demonstrated analytical thinking, organization
skills and problem-solving skills.
- Ability to self-manage, prioritize and execute tasks in a demanding environment.
- Strong consultancy orientation and experience, with the ability to form collaborative,
productive working relationships across diverse teams and cultures is a must.
- Willingness and ability to train and teach others.
- Ability to facilitate meetings and follow up with resulting action items.

About the Client

A leading global specialist in energy management and automation

Industry

IT Services & Consulting

Minimum Experience:

4+ years

Additional Skills:

  • Lambda & Step Functions
  • AWS
  • Datawarehousing
  • RedShift
  • Data Lakes
  • Big Data
  • DevSecOps
  • Apache Spark
  • Glue Data Catalog

No of open positions:

3

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

Similar Freelance Projects you can apply to.

View More Projects btn btn

More than 3000 clients rely on Flexing It today

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.