Job Description:
Our client - a major utility firm based out of Westchester County, NY - has an immediate need for an ETL Developer / Data Engineer. The particulars of the position are as follows.
Project Overview:
The details of the different ETL development that will be enabled over the duration of the project are outlined below.
• Analyze the ETL mapping sheet of customer data and create a hierarchy for Organizations, Facilities, Accounts and meters
• Analyze the existing hierarchy and propose changes to improve the overall data quality.
• Create detailed design documents for development team use on new or existing customer integrations
• Update the DevOps tasks and assist business in prioritizing the tasks in sprints
• Develop test cases and test the data in QA environment
• Develop ETL flows to ingest data into NYEM platform by extracting, transforming, loading from Energy Cap, BSNY, SAP and other etc.
Job Functions & Responsibilities:
ETL Development:
• Design, build, and maintain efficient ETL workflows to process and integrate solar, Interval, etc., data from multiple sources.
• Optimize ETL processes for performance and scalability.
Data Integration:
• Collaborate with data providers and stakeholders to ensure accurate data ingestion and transformation.
• Develop mechanisms for real-time and batch solar data processing.
Data Quality & Validation:
• Implement robust data validation and cleansing techniques.
• Ensure data accuracy and consistency.
Collaboration:
• Work closely with the business, and analysts.
• Coordinate with IT teams to deploy ETL pipelines in production environments.
Documentation:
• Document ETL processes, workflows, and best practices.
• Maintain clear and concise technical documentation for stakeholders.
Skills:
Technical Skills:
• Proficiency in ETL tools such as Pentaho/Microsoft ADF.
• Strong SQL and database management skills (e.g., SQL Server).
• Experience with cloud platforms (e.g., AWS, GCP, Azure).
• Knowledge of Python, Spark, or other programming languages for data processing.
Preferred Skills:
• Familiarity with energy management systems or renewable energy analytics.
• Experience with REST APIs and integrating IoT data, timeseries and Utility Data.
Soft Skills:
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork abilities.
Education & Certifications:
Education:
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
Experience:
• 5+ years of experience as a Data Engineer or ETL Developer.
• Proven experience in integrating energy, interval data, is preferred.
For Immediate Response call 732-876-7624, or send your resume to RecruiterLS@Trigyn.com
TRIGYN TECHNOLOGIES, INC. is an EQUAL OPPORTUNITY EMPLOYER and has been in business for 35 years. TRIGYN is an ISO 9001:2015, , ISO 27001:2013 (ISMS),ISO 20000:2018 and CMMI Level 5 certified company.