Data Engineer

• Company IBM Banglore
• No. of Openings 4
• Salary Not Disclosed
• Work Type on-site

Job Description :

• As a Data Engineer you Will be responsible for driving the overall solution design and determining the architecture necessary for the BI team to develop and implement large complex projects
• Responsible for managing data architectures, modern data platforms, big data, ML/AI, analytics, cloud platforms, data governance and information management and associated technologies
• Develop and demonstrate Proof of Concepts and Working Demos
• Works with business partners, development teams and senior designers to capture requirements, determine a solution that will integrate with existing/new BI assets, review prototypes and develop iterative revisions
• Responsible for leading the design of prototypes and determining final design to ensure client satisfaction with the solution
• Conduct impact assessment with business in order and determine high level design and size of effort based on requirements
• Transforms datasets, quantitative and qualitative analysis into compelling visuals
• Partners and support developers through the development of complex routines to load a dimensional star schema (and supporting layers) and develops error handling processes. Similarly, supports the reporting team for the visualization build
• Perform an active, leading role in shaping and enhancing overall solution, including standard patterns and best practices
• Identifies opportunities for new architectural initiatives; makes recommendations on the increasing scalability and robustness of DWH platforms and solutions
• Drive improvements and enhancements to the current data landscape and future strategy
• Partner with Leadership team to ensure the successful delivery of projects
• Remain current on new ETL/Visualization techniques and methodologies and communicate trends and opportunities to management and other developers as needed
• Identify opportunities for uses of those technologies to enhance current or anticipated information systems and business goals needs
• Support developers by providing technical assistance, troubleshooting and alternative development solutions.
• Playing a key role in mentoring other staff members and a proven track record in knowledge transfer to other team members and departments
• Identifies alternative uses of technologies that will enhance current or anticipated information systems and that support overall corporate and business goals that are appropriately aligned with the enterprise architecture
• Communicates risks and ensures understanding of these risks.

Required Technical and Professional Expertise

• Minimum of eight years of related experience required
• Experience in modeling and business system designs
• Good hands on experience on DataStage, Alteryx, Informatica & SSIS
• Have great expertise in writing TSQL code
• Experience in writing advanced Python and Spark for Data Processing
• Must have hands on experience on multiple cloud-based solutions like Red HAT, Azure, AWS and IBM Cloud for data storage, database and ETL implementations and Visualization creation
• Must have proven experience with STAR and SNOWFLAKE schema techniques
• Proven track record as an ETL/Visualization expert, leading development teams to deliver successful business intelligence solutions with complex data sources
• Have hands on experience on Power BI, Tableau and Cognos Analytics
• Core Expertise in Cognos 11 BI Series or higher - both framework modeling as well as report writing (Report Studio, Query Studio, Analysis Studio and Framework Manager in Cognos)
• Well versed with data warehouse schemas and OLAP techniques

Preferred Technical and Professional Expertise

• Ability to manage and make decisions about competing priorities and resources.
• Ability to delegate where appropriate.
• Must be a strong team player/leader.
• Ability to lead Data transformation project with multiple junior data engineers
• Strong oral written and interpersonal skills for interacting and throughout all levels of the organization.
• Ability to clearly communicate complex business problems and technical solutions