Overview
Software Developer, SQL, Data Engineer Jobs in Toronto – Ontario at Foilcon
Title: Software Developer, SQL, Data Engineer
Company: Foilcon
Location: Toronto – Ontario
Category: Software Development, IT/Tech
Position: Software Developer 6016
Description :
General
Responsibilities
Design, develop and implement ingestion framework from Oracle source to Azure Data Lake – initial load and incremental ETL. Used tools are:
Azure Data Factory (expert knowledge) to maintain pipeline from Oracle to Azure Data Lake Azure Synapse to build stored procedures and read data from data lake Review the requirements, database tables, and database relationships – Identify gaps and inefficiencies in current production reporting environment and provide recommendations address them in the new platform. Continue to evolve and design ingesting framework and CDC Prepare design artifacts Analysis of data – physical model mapping from data source to reporting destination.
Understand the requirements. Recommend changes to the Physical model. Develop the scripts of physical model, and create DB. Access Oracle DB environments, use SSIS, SQL Server and other development tools for developing solution. Proactively communicate with business on any changes required to conceptual, logical and Physical models, communicate and review dependencies and risks. Development of ETL strategy and solution based on different set of modules Understand the Tables and Relationships.
Create low level design documents and unit test cases. Create the workflows of package design Development and testing of data with Incremental and Full Load. Develop high quality ETL mappings/scripts/jobs ETL data from Applications to Data Warehouse ETL data from Data Warehouse to Data Mart Perform unit tests. Performance Review, data Consistency checks Troubleshoot performance issues, ETL Load issues, log activity for each Individual package and transformation.
Review Performance of ETL Overall. End to end Integrated testing for Full Load and Incremental Load Plan for Go Live, Production Deployment. Create production deployment steps. Configure parameters, scripts for go live. Test and review the instructions. Create release documents and help build and deploy code across servers. Go Live Support and Review after Go Live. Review existing ETL process, tools and provide recommendation on improving performance and reduce ETL timelines.
Review Infrastructure and any pain points for overall
process improvement
Knowledge Transfer to Ministry staff, development of documentation on the work completed. Document share and work on the ETL end to end working knowledge, Troubleshooting steps, configuration and scripts review. Transfer documents, scripts and review of documents. Experience and Skill Set
Requirements:
Experience:
Experience of
7+ years of working with SQL Server, ADF and T-SQL Development (Must Have)
Experience working
with building Databases, Data Warehouse and Data Mart and working with delta / incremental and full loads (Must Have)
Experience with
any ETL tools such as SQL Server, ADF, Cloud tools (Must Have)
Experience working
with MSSQL Sever on premise and within Azure Environment (Must Have) Experience on Data modeling, and tools – e.g. SAP Power Designer,
Experience with
snowflake and star schema model. Experience in designing data warehouse solutions using slowly changing dimensions.
Experience working
with SQL Server SSIS and other ETL tools, solid knowledge and experience with SQL, …
