Overview
Data Engineer Jobs in Mississauga, Ontario, Canada at Smart IT Frame LLC
Title: Data Engineer
Company: Smart IT Frame LLC
Location: Mississauga, Ontario, Canada
Job Title: Data Engineer
Location: Mississauga
Employment Type: Full Time
Pyspark Must
About Smart IT Frame:
At Smart IT Frame, we connect top talent with leading organizations across the USA. With over a decade of staffing excellence, we specialize in IT, healthcare, and professional roles, empowering both clients and candidates to grow together.
Responsibilities:
- Design, develop, and maintain software solutions using Python.
- Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
- Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
- Develop back-end services, APIs, and integrate databases.
- Optimize applications for performance, security, and maintainability.
- Troubleshoot and resolve software defects and issues.
Required Skills:
- Strong proficiency in Python and Spark.
Regards,
Muraliraja
