This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept
search

Select a Skill

Talent

Join as Talent Post a project

checked This is a sample alert

logo

Consultant - Data Bricks

  • Full Time
  •  On-Site - Bangalore
  • 3 months
  • Project posted on: 18/11/2024

Consultant - Data Bricks

  • Information Technology
  • Software Development - web technologies
  • Technology Operations and Support
  • Technology Management

On-Site - Bangalore

Full Time

3 months

 18/11/2024

Assignment Details

Our client, a Global Leader in Energy Management and Automation, is seeking an Consultant - Data Bricks.

Roles and Responsibilities:

  • Design, build, and maintain data architectures (tables, index) and data processing pipelines (ingest, infra, scheduling).
  • Work with diverse data sources and formats: Azure Blob Storage, Kafka, REST APIs, JSON, CSV, Avro, etc
  • Develop efficient and high-performing ETL (Extract, Transform, Load) solutions.
  • Collaborate with business teams (data scientists, data analysts) and platform teams (develops, finos).
  • Ensure data quality, security, monitoring, and governance throughout the process.
  • Mastering or strong appetence for Python, SQL, Scala; Spark, DotNet or Java are a +.
  • Proficiency in both relational and non-relational databases.
  • Understanding of data engineering principles and data modelling
  • Experience with ETL tools, data processing platforms and event streaming platforms.
  • General Azure Cloud knowledge, Azure Databricks


 

Skills Required

Key Skills & Expertise:

  • Data Architecture & ETL: Design and maintain scalable data architectures and develop efficient ETL solutions.
  • Cloud & Azure: Strong expertise in Azure Cloud services, particularly Azure Databricks and Azure Blob Storage.
  • Programming: Proficient in Python, SQL, and Scala; experience with Spark is a plus.
  • Data Integration: Experience integrating diverse data sources/formats (e.g., Kafka, REST APIs, JSON, CSV).
  • Data Quality & Security: Ensure data quality, governance, and security throughout the data pipeline.
  • Collaboration: Work closely with cross-functional teams (data scientists, developers) to deliver end-to-end data solutions.

About the Client

A leading global specialist in energy management and automation

Industry

IT Services & Consulting

Minimum Experience:

6+ years

Additional Skills:

  • Python
  • SQL
  • Kafka
  • Azure Blob Storage
  • data architectures
  • Azure Databricks

No of open positions:

1

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

Similar Freelance Projects you can apply to.

IT Expert in CRM: Keynote Speaker (Manufacturing/Healthcare/Tech)

FMCG

  • ERP/CRM
  • Technology Operations and Support
  • CIO/CTO functions
  • Technology Management
clock_icon less than 1 month(s)
exp_icon15+ years
location_icon Remote
SKILLS REQUIRED
  • #Speaker
  • #CIO / CTO
  • #Leadsquare CRM
Apply

Consultant Azure DevOps

IT Services & Consulting

  • Software Development - web technologies
  • Technology Operations and Support
  • Software Development - Python
clock_icon 3 month(s)
exp_icon7+ years
location_icon On-Site
SKILLS REQUIRED
  • #Azure Blob storage
  • #Azure DevOps
  • #Docker and kubernetes
  • #Python
  • #CI/CD tools
  • #Azure SQL
Apply

Consultant - Data Bricks

IT Services & Consulting

  • Software Development - web technologies
  • Technology Operations and Support
  • Technology Management
clock_icon 3 month(s)
exp_icon6+ years
location_icon On-Site
SKILLS REQUIRED
  • #Python
  • #SQL
  • #Kafka
  • #Azure Blob Storage
  • #data architectures
  • #Azure Databricks
Apply

Consultant—Test Engineer (API and Microservices)

IT Services & Consulting

  • Software Development - web technologies
  • Quality Assurance & Testing
  • Technology Operations and Support
  • Information Security
  • Software architect
clock_icon 4 month(s)
exp_icon4+ years
location_icon On-Site
SKILLS REQUIRED
  • #Azure DevOps
  • #Microservices
  • # Test Management
  • #Security Testing
  • #RESTful
  • #POSTMAN
Apply

Consultant—Manual Tester (Windchill PLM Software)

IT Services & Consulting

  • Quality Assurance & Testing
  • Technology Operations and Support
  • Software architect
  • Technology Management
clock_icon 6 month(s)
exp_icon4+ years
location_icon On-Site
SKILLS REQUIRED
  • #CAD tools
  • #Test Management
  • #Defect Tracking
  • #Manual Testing
  • #SAP
  • #ERP systems
Apply

IT Expert in CRM: Keynote Speaker (BFSI)

Banking

  • ERP/CRM
  • Technology Operations and Support
  • CIO/CTO functions
  • Technology Management
clock_icon less than 1 month(s)
exp_icon15+ years
location_icon Remote
SKILLS REQUIRED
  • #BFSI
  • #Speaker
  • #CIO / CTO
  • #Leadsquare CRM
Apply

Consultant—Senior Firmware Engineer

IT Services & Consulting

  • Quality Assurance & Testing
  • Hardware and Network administration
  • Software architect
  • Technology Management
clock_icon 6 month(s)
exp_icon5+ years
location_icon On-Site
SKILLS REQUIRED
  • #Firmware Development
  • #RTOS
  • #Automation Engineer
  • #Embedded Systems Design
  • #Software Testing
  • #Embedded Software Development
Apply

Consultant-Network Architect

IT Services & Consulting

  • Software Development - Mainframe
  • Software Development - web technologies
  • Technology Operations and Support
  • Hardware and Network administration
  • Software architect
clock_icon 12 month(s)
exp_icon10+ years
location_icon Hybrid
SKILLS REQUIRED
  • #CISCO
  • #Juniper
  • #NTP
  • #DHCP
  • #DNS
  • #VLAN
Apply

Consultant—AWS Serverless Developer (Node.js)

IT Services & Consulting

  • Software Development - web technologies
  • DBA/datawarehousing
  • Software architect
  • Technology Management
  • Software Development - Python
clock_icon 4 month(s)
exp_icon4+ years
location_icon Hybrid
SKILLS REQUIRED
  • #Python
  • #Node.js
  • #AWS Serverless
  • #Software Development
  • #Data Engineering
  • #AWS Lambda
Apply

Consultant—Windchill Developer

IT Services & Consulting

  • Software Development - web technologies
  • Quality Assurance & Testing
  • Technology Operations and Support
  • Software architect
  • Technology Management
clock_icon 3 month(s)
exp_icon5+ years
location_icon On-Site
SKILLS REQUIRED
  • #PLM processes
  • #Windchill API
  • #PTC Windchill
  • #Windchill Customizations
Apply

Consultant-Software Design Engineer

IT Services & Consulting

  • Software Development - C/C#/.NET
  • Software Development - Mainframe
  • Software Development - web technologies
  • Technology Operations and Support
  • Information Security
clock_icon 6 month(s)
exp_icon7+ years
location_icon On-Site
SKILLS REQUIRED
  • #Agile Implementation and transitioning
  • #AWS
  • #Devops
  • #.NET
  • #Azure
  • #C#
Apply

Consultant - Product Manager

IT Services & Consulting

  • Project/Program Management
  • Technology Operations and Support
  • Information Security
  • Software architect
  • Product Management
clock_icon 3 month(s)
exp_icon8+ years
location_icon On-Site
SKILLS REQUIRED
  • #B2B
  • #agile
  • #JIRA
  • #P2P software
  • #Atlassian tools
Apply
View More Projects btn btn

More than 3000 clients rely on Flexing It today

item_1
item_2
item_3
item_4
item_5
item_6
item_8
item_9

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.