Posted On 29 August
You are a Data Engineer or you want to become one!
As part of a Big Data team reinforcement Involved in a project in the social field, we seek to strengthen ourselves on the data engineering component.
So that's where you come in!
What will be your role?
Activities:
Spark / Python development in Hadoop environment
Exploitation of parquet files
Scheduling in OOZIE
Rundeck to launch all channels
Scripting Shell / Bash
Agile: Participations in daily meetings, retrospective, use of the redmine tool
Data collection:
Retrieve XML files for transformation to CSV.
Apply metrics to these CSVs.
Data consolidation:
Implement management rules.
Implementation of business rule for extraction of consolidated data for the business
What this experience will bring you
You are autonomous, you have a sense of servie and analysis, you are involved, we offer you an opening on complex projects and rapid career development.
What we are looking for in you
As you will have understood, we are looking for Data Engineers with a first successful experience in Python and Spark development in Hadoop environment.
Why would you take the plunge?
Because Scalian is a group of specialists, with an ambitious development project, focused on innovation and committed to its customers where you can:
Build a tailor-made career path, varied and adapted to your desires, thanks to the variety of missions in your area of expertise and the bridges between the trades
Learn by the quality of the projects on which you will intervene, in your specialty, and thanks to the wide catalog of training delivered by our internal Academy
Have an attractive social framework that respects everyone's needs (teleworking agreement, crèches, social security coverage, flexibility, soft mobility, etc.)
Contribute to R&D topics or participate in internal projects
Be part of a friendly team that will rhyme work with pleasure!
Who are we?
Human and technology to scale sustainable performance
Created in 1989, Scalian is a French group with an international dimension, with offices in Europe and North America, specialized in the transformation of companies through its dual mastery of business processes and digital technologies.
In the TOP10 engineering consulting companies in France, the Group is involved in service activities in industrial project management, supply chain (costs, quality, deadlines, performance), architecture and development of embedded digital systems, information systems and artificial intelligence applications. Scalian also deploys solutions for optimizing projects or organizational performance and responds to transformation challenges for industry and tertiary leaders (energy, transport, space, banking, health, environment, etc.).
The Group has 3,000 consultants and engineers in seven countries with a turnover of 256 million euros.