Skip to content
Lead – Software Engineer Data Solution Architect – Aws
| Company | Prudential Financial |
|---|
| Location | Newark, NJ, USA |
|---|
| Salary | $138500 – $206000 |
|---|
| Type | Full-Time |
|---|
| Degrees | |
|---|
| Experience Level | Expert or higher |
|---|
Requirements
- Expertise in architecture, designing and building scalable cloud-based application leveraging AWS services.
- Proven experience with services like EC2, ECS, Kong, ALB, SQS/SNS, Kinesis, RDS, S3, Lambda, Glue, DynamoDB, EMR, VPC, Route 53, CloudFormation/Terraform, CloudWatch, Dynatrace, IAM
- Experience in building scalable and stronger data pipelines to support data integration, data processing, data quality and monitoring.
- Experience in handling various hierarchical data structures and file formats such as parquet, Json and Avro files
- Strong knowledge of DevOps principles and methodologies and toolset experience in bitbucket/GitHub and Jenkins/Terraform in adopting CI/CD approach.
- Automate infrastructure provisioning and configuration management using as code, with experience in tools such as Terraform or CloudFormation.
- Proficient in: Programming languages: Python, PySpark / Scala is mandatory; Database: PostgreSQL, DynamoDB, Redis, GraphDBs; Architecture & Design Patterns: Specialized in Microservices and Service-oriented Architecture (SoA) with a focus on building web service APIs using REST and SOAP protocols, and adept in handling JSON and XML data formats; Software security skills: Proficient in secure coding, web application security, and DevSecOps with a strong understanding of concepts like authentication, authorization, encryption, digital signature, JWT, SSL, web service proxies, firewall, SAML 2.0, OpenID Connect, and OAuth 2.0; DevOps Tools & Practices: Skilled in branching techniques and the use of platforms such as GitHub and Bitbucket; proficient in DevOps practices and tools, including Jenkins; Proficient in monitoring and logging techniques used throughout the SDLC.
Responsibilities
- Design and build scalable solutions and services in AWS, ensuring the solution meets business and technical requirements.
- Professional hands-on experience in developing extensible data pipeline and reusable data processors using PySpark, Scala, Python in AWS Glue and Lambda functions.
- Architect and develop secure, robust cloud-based services, real-time APIs, service integrations, and automations using a microservice architectural style.
- Lead the Solution design and implementation of solutions using AWS services.
- Maintain proficiency and implement best practices in AWS development tools and standards.
- Define and deploy job monitoring, metrics, and logging systems on AWS.
- Implement continuous integration and deployment (CI/CD) pipelines.
- Ability to comprehend requirements, identify potential tools/services in the market, and conduct comprehensive assessments leading to an informed selection process.
- Ability to coach/interact other technical resources, enterprise architects and cloud architects with minimal guidance and effectively leverage diverse ideas, experiences, thoughts, and perspectives to the benefit of the organization.
- Ability to excel in both independent and collaborative team environments.
- Lead the troubleshooting and resolution of issues in development, test, and production environments.
Preferred Qualifications
- 10-12 years of experience as an AWS Cloud Data Architect or related role.
- Involved in Architecture & design of Enterprise cloud systems.
- Strong understanding of data engineering principles and methodologies.
- Solution Design Thinking
- Experience in performing detailed tool Assessment and selection process.
- Knowledge of data governance, metadata management and data quality is a plus.
