This is a sample alert
Our client, a leading global specialist in energy management and automation, is seeking Independent Data Engineers to work with current technologies used by IntelDS and in particular Apache Spark, Lambda & Step Functions, Glue Data Catalog, and RedShift on AWS environment.
Key Responsibilities:
Design and develop new data ingestion patterns into IntelDS Raw and/or Unified data
layers based on the requirements and needs for connecting new data sources or for
building new data objects. Working in ingestion patterns allow to automate the data
pipelines.
Participate to and apply DevSecOps practices by automating the integration and delivery
of data pipelines in a cloud environment. This can include the design and implementation
of end-to-end data integration tests and/or CICD pipelines.
Analyse existing data models, identify and implement performance optimizations for data
ingestion and data consumption. The objective is to accelerate data availability within the
platform and to consumer applications.
Support client applications in connecting and consuming data from the platform, and
ensure they follow our guidelines and best practices.
Participate in the monitoring of the platform and debugging of detected issues and bugs.
Minimum of 3 years prior experience as data engineer with proven experience on Big Data and Data Lakes on a cloud environment.
Bachelor or Master degree in computer science or applied mathematics (or equivalent).
- Proven experience working with data pipelines / ETL / BI regardless of the technology.
- Proven experience working with AWS including at least 3 of: RedShift, S3, EMR, Cloud
Formation, DynamoDB, RDS, lambda.
- Big Data technologies and distributed systems: one of Spark, Presto or Hive.
- Python language: scripting and object oriented.
- Fluency in SQL for datawarehousing (RedShift in particular is a plus).
- Good undesrtanding on datawarehousing and Data modelling concepts
- Familiar with GIT, Linux, CI/CD pipelines is a plus.
- Strong systems/process orientation with demonstrated analytical thinking, organization
skills and problem-solving skills.
- Ability to self-manage, prioritize and execute tasks in a demanding environment.
- Strong consultancy orientation and experience, with the ability to form collaborative,
productive working relationships across diverse teams and cultures is a must.
- Willingness and ability to train and teach others.
- Ability to facilitate meetings and follow up with resulting action items.
A leading global specialist in energy management and automation
IT Services & Consulting
4+ years
3
Build your
skill profile
Strengthen it
with feedback
Determine your
optimal fee level
Apply for matching
projects
Get finalized
Stay Engaged
FMCG
IT Services & Consulting
Electricial Utilities and Power Producers
IT Services & Consulting
Professional Services - Data Analytics
IT Services & Consulting
Electricial Utilities and Power Producers
Electricial Utilities and Power Producers
IT Services & Consulting
Electricial Utilities and Power Producers
IT Services & Consulting
IT Services & Consulting
More than 3000 clients rely on Flexing It today
We host both full-time & part-time projects from top clients for 100+ skill categories. We also help connect experts like you with clients for short consultation calls called Flexperts
You just need to create a ‘boutique firm’ account during the registration process. The rest of the application process remains the same.
Our freelancers fee benchmarking tool, FeeBee helps our freelancers and consultants find out what their peers charged for similar projects. Built on 600K+ verified benchmarks, registered users get unlimited access to it.
As a freelancing platform, we do not provide permanent positions or full-time job to our consultant network.
Flexing It will be involved end to end right from contracts to invoicing. Once you are finalized, your payment details are transparently laid out in your contract terms with your client and our team actively liaises with the client finance team to ensure timely payments.
We do not charge any fee or commission from you. Your fee quote will be paid out to you in full as per your project contract.