Compunnel, Inc.
Python/PySpark Developer
Job Description
We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions. The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration. This role requires a deep understanding of algorithms, data structures, and best practices for building scalable and efficient systems. Key Responsibilities
Develop and maintain applications using Python and PySpark. Implement ETL/ELT processes and integrate data pipelines. Utilize Databricks for data processing and analytics. Perform code testing and analysis using tools such as Pytest and Pylint. Collaborate with cross-functional teams to design and deliver high-quality solutions. Apply architectural design patterns and best practices throughout the SDLC. Consume APIs (REST and others) for data integration. Work in an Agile development environment and participate in sprint planning and reviews. Use...
Develop and maintain applications using Python and PySpark. Implement ETL/ELT processes and integrate data pipelines. Utilize Databricks for data processing and analytics. Perform code testing and analysis using tools such as Pytest and Pylint. Collaborate with cross-functional teams to design and deliver high-quality solutions. Apply architectural design patterns and best practices throughout the SDLC. Consume APIs (REST and others) for data integration. Work in an Agile development environment and participate in sprint planning and reviews. Use...