Pycodex

Senior Software Developer – AWS Glue and ETL

Location: Islamabad Office – Onsite Job Type: Full-Time Experience Level: 3 – 6 Years

Job Summary:

We are seeking a highly skilled Senior Software Developer with expertise in AWS Glue and ETL to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing ETL pipelines while ensuring seamless data integration and transformation. This role requires strong proficiency in Apache Spark, AWS Glue, and schema-on-read architectures to enable efficient data processing.

Key Responsibilities:

1. AWS Glue Integration & Enablement

Introduce AWS Glue as the primary ETL tool in the technology stack.
Configure AWS Glue Crawlers, Data Catalogs, and ETL jobs to automate schema discovery, normalization, and metadata management.
Establish best practices and guidelines for AWS Glue adoption.
2. Data Catalogs and Schema-on-Read

Design and implement schema-on-read architectures for dynamic schema interpretation.
Create and maintain centralized data catalogs using AWS Glue for metadata management.
3. ETL Process Design & Optimization

Develop agile ETL workflows for processing diverse data formats (JSON, CSV, text files).
Optimize ETL processes for scalability, performance, and error handling.
4. Spark-Based Reusable Code Development

Build modular, reusable Spark code for data processing, transformation, and cleaning.
Ensure code is optimized for performance and scalability across multiple data sources.
5. Configuration-Driven Pipelines

Design low-code ETL workflows using configuration-based setups.
Collaborate with non-technical stakeholders to develop user-friendly interfaces for data pipeline configuration.
6. Data Quality and Validation

Implement robust QA mechanisms to validate data integrity across the ETL pipeline.
Develop automated validation scripts to ensure data accuracy and compliance with standards.
7. Collaboration and Leadership

· Work closely with cross-functional teams, including data engineers, software developers, and product managers, to align ETL pipelines with business requirements.

· Mentor junior team members in AWS Glue best practices and advanced ETL development techniques.

8. Monitoring and Maintenance

· Integrate monitoring tools such as AWS CloudWatch to provide visibility into ETL job performance and ensure timely issue resolution.

· Establish documentation for ETL processes, AWS Glue configurations, and reusable code components.



Qualifications & Skills:

Proven experience with AWS Glue, including Data Catalogs, Crawlers, and ETL job configuration.
Strong expertise in Apache Spark for data processing and transformation.
Hands-on experience with schema-on-read architectures and managing evolving data schemas.
Proficiency in ingesting and processing heterogeneous data sources (e.g., JSON, CSV, text).
Experience developing modular, reusable code for data wrangling and transformation.
Deep understanding of data quality and validation strategies in ETL pipelines.
Proficiency in Python or Scala for Spark and AWS Glue development.
Familiarity with AWS services such as S3, Athena, and Redshift.
Strong knowledge of configuration-driven ETL design principles.
Experience with monitoring and logging tools such as AWS CloudWatch.
Knowledge of performance tuning in Spark-based ETL workflows.
Ability to document workflows and provide technical training.
Excellent problem-solving skills and attention to detail.
Ability to work independently and manage multiple priorities in a fast-paced environment.
Preferred Qualifications:

Experience in big data processing and real-time data pipelines.
Knowledge of DevOps and CI/CD practices for data engineering workflows.
Familiarity with data security and compliance standards.
Benefits:

Competitive salary and performance-based bonuses.
Gratuity, medical Insurance and paid leaves
Collaborative and innovative work environment.





Skills
Python Framework Command
Data Catalogs
ETL Tools
AWS Glue
Job Detail
Experience: 3 Years - 6 Years
Salary: Rs. 300,000 - 350,000
shaew your resume artr [email protected]

Send a message to learn more

Senoir Java Developer

Location: Lahore onsite

Job Description:

We are looking for a highly skilled Java Developer with 3-5 years of experience in core Java development using Spring Boot & Microservices. The ideal candidate should be passionate about developing high-quality, scalable, and efficient software solutions.
Key Responsibilities:

• Design, develop, and maintain complex custom-built solutions using Java technology and related frameworks.

• Implement Spring Boot and Microservices architecture to enhance system scalability and maintainability.

• Integrate and develop REST/SOAP-based web services and microservices.

• Participate in the ex*****on and documentation of tests to ensure optimal application performance.

• Utilize object-oriented technologies, design patterns, and best practices to create high-quality software solutions.

• Collaborate with cross-functional teams to define, design, and ship new features.

• Troubleshoot and resolve technical issues, ensuring optimal application performance.

• Work with Oracle database platforms to develop and optimize queries.

• Implement frontend solutions using JavaScript, JSON, and jQuery where necessary.

• Bachelor’s/Master’s degree in Computer Science or equivalent from a reputed university.

• 3-5 years of hands-on experience in Java development.

• Strong expertise in Spring Boot, Microservices, and REST/SOAP API development.

• Proficiency in object-oriented programming, design patterns, and software development best practices.

• Experience with Oracle databases for data management and optimization.

• Basic knowledge of frontend technologies such as JavaScript, JSON, and jQuery.

• Strong problem-solving skills with the ability to troubleshoot complex issues.

• Excellent communication and collaboration skills.

Preferred Skills:

• Experience working in an Agile development environment.

• Knowledge of cloud platforms (AWS, Azure, or GCP).

• Familiarity with CI/CD pipelines and DevOps practices.


Skills
GCPs
Azure
AWS CWI
Cloud Applications
Agile Application Development
Job Detail
Experience: 3 Years - 5 Years
Salary: Rs. 350,000 - 450,000
share your resume at [email protected]

Send a message to learn more