Job Title :
Data Engineer
Position ID :
Location :
Pan India
Job Type :
Full Time
State/Province :
Pay Rate :
Country :
Contact Recruiter :
Job Description

The ideal candidate shall possess excellent knowledge of:

• Stack of Azure and AWS BI and data services
• A minimum of 5 years of work experience in the requested skills
• Data analysis and modelling
• Database scripting (T-SQL, stored procedures, etc.)
• Microsoft Business Intelligence modules covering Integration Services (SSIS), Reporting Services (SSRS), Analysis Services (SSAS)
• Microsoft SQL Server, Azure Data Factory, AWS Athena/RDS, Redshift, AWS Glue
• Expert python developer o Including experience with frameworks and libraries like Django, Flask, streamlit, pandas and numpy, apache spark
• Knowledge of git and Linux OS (Ubuntu / debian / centOS)
• Strong knowledge and experience with C#, .NET, Python, Javascript and CSS
• Strong experience defining and implement CI/CD pipelines with Azure devops
• Strong scripting skills with PowerShell and/or Bash shell

Scope of Work / Duties of Consultant:

• Work with the team (technical Lead/Architect/other team members) and customer focal point to understand the business need and design/implement the technical data management solution.
• Design and implement Data Warehouses and Data Lakes solutions, mainly Microsoft Cloud and AWS data services, based on the customers’ business requirements.
• Design and implement complex ELT/ETL processes using Integration Services (SSIS), Azure Data Factory or AWS Glue or others
• Design and develop Analysis Services OLAP Cubes and Tabular Views
• Develop scripts according to the data need (Stored Procedures with T-SQL, Python or R, eventually PowerShell or .NET).
• Design conceptual and logical data models and data flowcharts
• Design Data-as-a-Service solution, on-premises and Cloud based, based on Data API Gateway and other Cloud services.
• Implement Data Catalog solutions
• Migrate data from legacy systems to new data platform solutions
• Improve system performance by conducting tests, troubleshooting and integrating new elements
• Optimize new and current database systems
• Perform other duties as required

Required Technical Skills:

The resource MUST have the following skills and experience:
• Microsoft Power BI or Tableau
• Good Understanding of Data engineering pipelines
• Knowledge of Data pipeline orchestrators and tools such as Azure Data Factory, Azure logic
apps, and AWS Glue
• Knowledge of python Data pipeline development with pyspark using Apache spark and
• Experience working with OData
• Experience working with SharePoint 2013/2016
• Experience with Service Management tools (ticketing systems)
• Experience with Service Management methodologies (ITIL) and Change Management
• Experience with Project Management methodologies (PRINCE2)
• Excellent technical documentation skills
• The ability to communicate effectively, persuasively and with clarity
• Customer-centric approach to delivery and problem solving

The resource SHOULD have the following skills and experience:

• Good communication skills
• Knowledge of Agile development methodology and concepts
• The candidate should possess strong analytical and problem-solving skills and be familiar with large scale BI and Data Analytics environments
• The candidate should also have experience working with geographically dispersed teams
• Experience working with large non-profit Organizations (UN)
• Knowledge of a second UN language would be an asset
Required Soft Skills:
• Excellent written and verbal communication skills, interpersonal and collaborative skills
• High degree of initiative, proactive and ability to work with little supervision
• Ability to deliver quality results
• Excellent communication, facilitation, and interpersonal skills with the ability to convey complex topics through effective documentation as well as presentations to all levels of the organization
• Excellent organizational skills, reporting and documenting
• Excellent written and spoken English
• Ability to effectively collaborate with teams in an international, multicultural, multi-disciplinary environment working under different time-zones

Desirable certifications:

• Bachelor’s degree in Computer Science, Data Science, Engineering, Information Systems or similar
• Microsoft SQL Server and BI certifications, Azure or AWS certifications are highly desirable.

Apply Now