1+ months

Senior-Big Data Engineer

Alpharetta, GA 30009
Apply Now
Apply on the Company Site
Collaborate with critical stakeholders to understand business needs, priority, and the quality of services to be created or enhanced within a CDO data platform target architecture framework (both Azure and AWS). Develop the necessary enablers and data platform in the multi cloud Big Data Lake environment and maintain its integrity during the life cycle phases. Drive solution to be compliant with CDO target state architecture. Support key IAAS/PAAS/SAAS functions around the CDO big data cloud platform solutions. Deliver framework which can blueprint different subscriptions and be compliant with AT&T standards and security policies built with the principle focus on automation, reusability and self-service. Develop mechanisms to ingest, analyze, validate, normalize and clean data. Develop and maintain data engineering best practices and contribute to insights on data analytics and visualization concepts, methods and techniques. Support automation and engineering around CDO core shared services on the cloud for account/subscription mgmt., architecture and security patterns, ci/cd pipeline and orchestration, Astra security and compliance, Nifi, TWS, interfaces (data router, message router, Connect Direct, Golden Gate etc). Develop and configure IT solutions to streamline the continuous integration pipeline. Design and develop test automation to validate the code builds in CI pipeline using Jenkins. Contribute to the design and implementation of continuous integration and delivery processes and systems for highly available and performant application stacks. Create and maintain highly scalable and fault tolerant multi-tier AWS and Azure environments spanning across multiple availability zones using Terraform and CloudFormation. Deploy and maintain ELK cluster both managed and stand-alone clusters with Nginx/LDAP authentication. Develop Ansible playbooks for remote orchestration of multiple cloud resources. Interact with development teams, product and customers. Engineer operational requirements, test cases, technical documentation to provide operational support. Maintain, & support cloud solutions Ensure standard processes exist for systems installation, configuration, patching, and upgrading. Write terraform scripts from scratch for building Dev, Staging, Prod and DR environments. Troubleshoot application issues to determine network routing and load balancing issues. Tune TCP profiles for various applications like batch jobs and application load balancing. Evaluate TLS/SSL profiles, protocol levels (TLS 1.2, 1.1) and ciphers, restricting ciphers for security. Utilize Hybrid cloud environments both AWS & Azure. Use AWS services like EC2, ELB, Lambda, Route53, EKS, Active Directory, VPC, IAM, AMI, S3 and RDS. Utilize Azure services like VM, VMSS, Vnets, AKS, LBs, PLS.PLE, DNS Zones, Storage Accounts, Azure Monitor, Log Analytics. Utilize monitoring tools like Prometheus, Grafana & Alertmanager. Utilize Cloud Compliance tools like Astra and patching the virtual machines. Implement centralized monitoring and alerting systems across multiple cloud environments both AWS & Azure. Use Docker containers and Kubernetes Containerized solutions both on-prem and on Cloud environments. Utilize CI/CD technologies using Jenkins pipeline build and deployments for automation and builds. Use Terraform & CloudFormation for automated cloud infra deployments. Use Data movement tools/technologies like SFTP, Connect Direct. Build and configuring NIFI environments. Utilize scripting languages like Shell, PowerSHell, Python, Bash.


Requires a Bachelors degree, or foreign equivalent degree in Computer Science, Electrical Engineering, or Information Technology and Five (5) Years of progressive, post-baccalaureate experience in the job offered or Five (5) Years of progressive, post-baccalaureate of experience: developing mechanisms to ingest, analyze, validate, normalize and clean data; developing and maintaining data engineering best practices and contribute to insights on data analytics and visualization concepts, methods and techniques; utilizng Hybrid cloud environments both AWS & Azure; using AWS services like EC2, ELB, Lambda, Route53, EKS, Active Directory, VPC, IAM, AMI, S3 and RDS; utilizng Azure services like VM, VMSS, Vnets, AKS, LBs, PLS.PLE, DNS Zones, Storage Accounts, Azure Monitor, Log Analytics; utilizing monitoring tools like Prometheus, Grafana & Alertmanager; utilizing Cloud Compliance tools lie Astra and patching the virtual machines; implementing centralized monitoring and alerting systems across multiple cloud environments both AWS & Azure; using Docker containers and Kubernetes Containerized solutions both on-prem and on Cloud environments; utilizing CI/CD technologies using Jenkins pipeline build and deployments for automation and builds; using Terraform & CloudFormation for automated cloud infra deployments; using Data movement tools/technologies like SFTP, Connect Direct; building and configuring NIFI environments; and utilizing scripting languages like Shell, PowerSHell, Python, Bash.


AT&T is an Affirmative Action/Equal Opportunity Employer, and we are committed to hiring a diverse and talented workforce. EOE/AA/M/F/D/V *np*
AT&T will consider for employment qualified applicants in a manner consistent with the requirements of federal, state and local laws

We expect employees to be honest, trustworthy, and operate with integrity. Discrimination and all unlawful harassment (including sexual harassment) in employment is not tolerated. We encourage success based on our individual merits and abilities without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, disability, marital status, citizenship status, military status, protected veteran status or employment status
Posted: 2022-07-25 Expires: 2022-10-02
Sponsored by:
ADP Logo

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Senior-Big Data Engineer

AT&T
Alpharetta, GA 30009

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast