Data Engineer (Python/AWS)

Amazon strives to be Earth's most customer‑centric company where people can find and discover virtually anything they want to buy online. By giving customers more of what they want – low prices, vast selection, and convenience – Amazon continues to grow and evolve as a world‑class e‑commerce platform.
The data engineering team – a part of the pricing Big Data team – is responsible for building and maintaining the data platform that helps Amazon businesses worldwide maintain price competitiveness. By collating and transforming large amounts of data from various sources, exposing pricing gaps via dashboards and reports, and enabling deep dives to extract insights, the data engineering team helps improve operational efficiency and meet business goals around pricing.
You will be part of a team that works with the tech, analytics, product, machine learning and technology teams to provide a real‑time data processing solution that gives Amazon leadership, PMs and stakeholders timely, flexible and structured access to customer insights. The team will be responsible for building this platform end‑to‑end using the latest AWS technologies and software development principles.
As a Data Engineer, you will lead the architecture, design and development of the data, metrics and reporting platform for Pricing. You will architect and implement new and automated Business Intelligence solutions, including big data and new analytical capabilities that support our Development Engineers, Analysts and Retail business stakeholders with timely, actionable data, metrics and reports while satisfying scalability, reliability, accuracy, performance, and budget goals, and driving automation and operational efficiencies. You will partner with business leaders to drive strategy, prioritize projects and feature sets, write and review business cases, and drive the development process from design to release. In addition, you will provide technical leadership and mentoring for a team of highly capable data engineers.
Own design and execution of end‑to‑end projects
Own managing Amazon Pricing services data infrastructure
Build end‑to‑end data pipeline for Amazon Pricing
Establish key relationships which span Amazon business units and Business Intelligence teams
Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs
2+ years of data engineering experience
Experience with data modeling, warehousing and building ETL pipelines
Experience with one or more query languages (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
Experience with one or more scripting languages (e.g., Python, KornShell)
Bachelor's degree or above in computer science, computer engineering, or related field
Experience with big data technologies such as Hadoop, Hive, Spark, EMR
Experience with any ETL tool like Informatica, ODI, SSIS, BODI, Datastage, etc.