Principal-Big Data Engineer

Company: AT&T
Location: Palo Alto
Posted on: November 22, 2021

Job Description:

**Job Description**Bring the world together with technology created and reimagined by you. At AT, you'll drive meaningful innovation across telecommunications and entertainment solving real-world problems that transform our company and your career. We're committed to those who seek to discover the undiscoverable and dare to disrupt the norm. Step into a career with AT and you won't just imagine the future - you'll create it.As a Senior Big Data Engineer, you will be responsible for the fundamental technology work of architecting/designing/building the core frameworks for our cloud-based system platforms and end to end solutions, including building cloud platform and performance components. Make high-level design choices and dictates technical standards, tools, and platforms and must have an understanding of systems engineering principles derived from experience. This position is part of the Data platform team that resides within the Chief Data Office of AT ATS. The Data platform cloud-based solution will help enable data sharing across business units in support of BI and Analytics related use cases. This role works with the Cloud Platform Engineering and Implementation Architecture group.Key Roles and ResponsibilitiesCollaborate with critical stakeholders to understand business needs, priority, and the quality of services to be created or enhanced. Drive solution to be compliant with Target State Architecture. Drive enhancements to Target State Architecture to meet future business needs. Responsible for discovering and identifying any bottleneck gaps such as manual flows that can hinder the services or impact cycle time or cost and resolve them early during the solution, design, and construction phase. Drive research and standardization of platform components that can make up the building blocks from which AT will build applications and services. Ensure applications and services are leveraging building blocks whenever possible. Ensure integration of nonfunctional requirements such as security, scalability, resiliency, and performance in all solutions. Define and design functional, technical, performance, and reliability solutions in line with client inferred requirements. Solves complex performance issues. Creates massive distributed systems. Creates integrated solutions between legacy and target state solutions. Create vendor guidelines and best practices.Qualifications+ Bachelor's in Computer Science, Engineering, Math, or similar degree and 5 years of experience in software architecture+ At least 3 years of strong hands-on working knowledge in Linux/Unix required.+ Hands on working experience with Azure/AWS+ Experience with Azure infrastructure, including implementing, monitoring and maintaining Azure compute, storage, network and security services.+ Strong background in troubleshooting with the ability to troubleshoot and identify the root cause for any issue (OS, App, infra apps).+ Experience with SOA applications and cloud-based services, preferably Azure.+ Experience working with Cloudera HDF NiFi and/or ADF, Ambari, Nifi, Kafka, Ranger, Kubernetes/Docker+ Experience working with cloud deployment tools such as Terraform and Ansible or similar scripting tools.+ Knowledge of web services, API, REST, and RPC.+ Strong awareness of networking and internet protocols, including TCP/IP, DNS, HTTP and distributed networks.+ Database experience, including knowledge of SQL and NoSQL, and related data stores such as Postgres.+ Experience with open-source technology, software development and system engineering, such as ElasticSearch.+ Experience with Python, Ruby, Perl or other scripting language\#ChiefDataOfficehttps://www.att.jobs/chiefdataofficeWe expect employees to be honest, trustworthy, and operate with integrity. Discrimination and all unlawful harassment (including sexual harassment) in employment is not tolerated. We encourage success based on our individual merits and abilities without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, disability, marital status, citizenship status, military status, protected veteran status or employment status.

Keywords: AT&T, Palo Alto , Principal-Big Data Engineer, Engineering , Palo Alto, California