This website uses cookies to ensure you get the best experience on our website. By continuing to use this site, you agree to our cookie  & privacy policy.Accept
search

Select a Skill

Talent

Join as Talent Post a project

checked This is a sample alert

logo

Consultant - Data Bricks

  • Full Time
  •  On-Site -
  • 3 months
  • Project posted on: 18/11/2024

Consultant - Data Bricks

  • Information Technology
  • Software Development - web technologies
  • Technology Operations and Support
  • Technology Management

On-Site -

Full Time

3 months

 18/11/2024

Assignment Details

Our client, a Global Leader in Energy Management and Automation, is seeking an Consultant - Data Bricks.

Roles and Responsibilities:

  • Design, build, and maintain data architectures (tables, index) and data processing pipelines (ingest, infra, scheduling).
  • Work with diverse data sources and formats: Azure Blob Storage, Kafka, REST APIs, JSON, CSV, Avro, etc
  • Develop efficient and high-performing ETL (Extract, Transform, Load) solutions.
  • Collaborate with business teams (data scientists, data analysts) and platform teams (develops, finos).
  • Ensure data quality, security, monitoring, and governance throughout the process.
  • Mastering or strong appetence for Python, SQL, Scala; Spark, DotNet or Java are a +.
  • Proficiency in both relational and non-relational databases.
  • Understanding of data engineering principles and data modelling
  • Experience with ETL tools, data processing platforms and event streaming platforms.
  • General Azure Cloud knowledge, Azure Databricks


 

Skills Required

Key Skills & Expertise:

  • Data Architecture & ETL: Design and maintain scalable data architectures and develop efficient ETL solutions.
  • Cloud & Azure: Strong expertise in Azure Cloud services, particularly Azure Databricks and Azure Blob Storage.
  • Programming: Proficient in Python, SQL, and Scala; experience with Spark is a plus.
  • Data Integration: Experience integrating diverse data sources/formats (e.g., Kafka, REST APIs, JSON, CSV).
  • Data Quality & Security: Ensure data quality, governance, and security throughout the data pipeline.
  • Collaboration: Work closely with cross-functional teams (data scientists, developers) to deliver end-to-end data solutions.

About the Client

A leading global specialist in energy management and automation

Industry

IT Services & Consulting

Minimum Experience:

6+ years

Additional Skills:

  • Azure Blob Storage
  • Kafka
  • Azure Databricks
  • data architectures
  • Python
  • SQL

No of open positions:

1

How it works

  • 1

    Build your
    skill profile

  • 2

    Strengthen it
    with feedback

  • 3

    Determine your
    optimal fee level

  • 4

    Apply for matching
    projects

  • 5

    Get finalized

  • 6

    Stay Engaged

Build your skill prodile

Project
step1
shape_step

Request feedback from prior projects and/or work stints

shape_step

Determine your optimal fee level

  • starFeeBee helps consultants understand how to price their services.
  • starEnter your skill & location to get ranges for what similar professionals have charged on projects.
  • starUnlock more details e.g., best paying sub-skills, ranges by projects durations, by simply adding a benchmark from a orior projects.
graph_step2
shape_step

Apply for matching projects

shape_step

Get finalized!

Project
step5
shape_step

Stay Engaged!

Project
step6
shape_step

Similar Freelance Projects you can apply to.

Android Platform - Video Consultant

IT Services & Consulting

  • Technology Operations and Support
clock_icon 12 month(s)
exp_icon8+ years
location_icon On-Site
SKILLS REQUIRED
  • #Android graphics pipeline
  • # Linux Kernel
  • #Android framework
  • # AOSP
Apply

Power BI Consultant

IT Services & Consulting

  • Software Development - web technologies
  • DBA/datawarehousing
  • Business Analysis
  • Product Management
clock_icon 12 month(s)
exp_icon5+ years
location_icon Remote
SKILLS REQUIRED
  • #Power Bi developer
  • #Analytics
  • #Data analysis
  • #Business Intelligence
  • #Data Warehousing
  • #Power BI
Apply

Consultant—Senior C++ Developer

IT Services & Consulting

  • Software Development - C/C#/.NET
  • Software Development - web technologies
  • Technology Operations and Support
  • Technology Management
clock_icon 3 month(s)
exp_icon8+ years
location_icon On-Site
SKILLS REQUIRED
  • #Qt Widgets
  • #Object-Oriented Programming
  • #QML Frameworks
  • #Qt3D
  • #C++ Development
  • #RadStudio
Apply

Consultant - Firmware Engineer

IT Services & Consulting

  • Software Development - C/C#/.NET
  • Software Development - mobile/telecom
  • Technology Operations and Support
  • Information Security
  • Software architect
clock_icon 6 month(s)
exp_icon4+ years
location_icon On-Site
SKILLS REQUIRED
  • #kernel
  • #Modbus TCP
  • #TCP/IP
  • #software architecture
  • #C
  • #Mesonbuild root
Apply

Consultant Test Automation Engineer

IT Services & Consulting

  • Quality Assurance & Testing
  • Technology Management
clock_icon 6 month(s)
exp_icon5+ years
location_icon On-Site
SKILLS REQUIRED
  • #Shell scripting
  • #VS code
  • #pycharms
  • #Modbus poll
  • #robot framework
  • #Wireshark
Apply

Data Analysis and Reporting Specialist

FMCG

  • Business Analysis
  • Technology Operations and Support
  • Data Science
clock_icon 3 month(s)
exp_icon4+ years
location_icon On-Site
SKILLS REQUIRED
  • #Data Analysis
  • #Data Validation
  • #KPI Tracking
  • #Sales Reporting
Apply

Consultant—AI/ML Engineer

Electricial Utilities and Power Producers

  • Technology Operations and Support
  • Technology Management
  • Software Development - Python
clock_icon 12 month(s)
exp_icon2+ years
location_icon On-Site
SKILLS REQUIRED
  • #Automation
  • #PyTorch
  • #Keras
  • #Python
  • #TensorFlow
  • #Application Support
Apply

Consultant-AI-Driven Smart Hiring Automation

IT Services & Consulting

  • Software Development - Mainframe
  • Software Development - web technologies
  • Project/Program Management
  • Quality Assurance & Testing
  • Technology Operations and Support
clock_icon 3 month(s)
exp_icon6+ years
location_icon Hybrid
SKILLS REQUIRED
  • #web development
  • #NLP models
  • #Developer
  • # AI-ML algorithms
  • #Machine Learning
  • #back-end development
Apply

Consultant - Delphi Developer

IT Services & Consulting

  • Software Development - C/C#/.NET
  • Software Development - web technologies
  • Quality Assurance & Testing
  • Information Security
clock_icon 12 month(s)
exp_icon4+ years
location_icon On-Site
SKILLS REQUIRED
  • #DELPHI V10
  • #Delphi
  • #SDLC
  • #DevOps
  • # application development
  • #Object PASCAL
Apply

Consultant- Embedded Tester

IT Services & Consulting

  • Software Development - C/C#/.NET
  • Software Development - web technologies
  • Quality Assurance & Testing
  • Technology Operations and Support
  • Software architect
clock_icon 6 month(s)
exp_icon5+ years
location_icon On-Site
SKILLS REQUIRED
  • #GitHub
  • #JIRA
  • #.NET
  • #ABAP
  • #Embedded C
  • #SDLC
Apply

Consultant Tableau Developer

IT Services & Consulting

  • Software Development - web technologies
  • DBA/datawarehousing
  • Business Analysis
  • UI/UX
  • Technology Management
clock_icon 3 month(s)
exp_icon7+ years
location_icon Hybrid
SKILLS REQUIRED
  • #ETL Development
  • #ETL
  • #Analytic development
  • #Presentation Skills
  • #Advanced Excel
  • #SQL
Apply

Consultant—Product Manager (Software Quality & Assurance)

Software Products & Services

  • Project/Program Management
  • Quality Assurance & Testing
  • Technology Operations and Support
  • Product Management
  • Technology Management
clock_icon 3 month(s)
exp_icon5+ years
location_icon Remote
SKILLS REQUIRED
  • #Software Quality Assurance
  • #Software Development Lifecycle
  • #Project Management
  • #Product Management
  • #QA methodologies
Apply
View More Projects btn btn

More than 3000 clients rely on Flexing It today

item_1
item_2
item_3
item_4
item_5
item_6
item_8
item_9

Frequently asked questions.

We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts

You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.

Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.

As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.

Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.

We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.