• Software Development Manager – Big Data, AWS Elastic MapReduce (EMR)

    Location US-CA-East Palo Alto
    Posted Date 2 months ago(1/4/2019 2:44 PM)
    Job ID
    Company/Location (search) : Country (Full Name)
    United States
  • Job Description

    Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services!

    Amazon EMR is a web service which enables customers to run massive clusters with distributed big data frameworks like Apache Hadoop, Hive, Tez, Flink, Spark, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling processing on vast datasets.

    We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to more easily interact with their data. We’re looking for managers who can build and lead teams to deliver such features from the ground up.

    Here are sample features that we have recently delivered:
    • Authenticate with Kerberos: https://aws.amazon.com/about-aws/whats-new/2017/11/now-enable-kerberos-authentication-and-emrfs-authorization-in-amazon-emr/
    • EMR Per Second Billing: https://aws.amazon.com/about-aws/whats-new/2017/10/amazon-emr-now-supports-per-second-billing/
    • Spark Application History in EMR Console: https://aws.amazon.com/about-aws/whats-new/2017/09/now-view-apache-spark-application-history-and-yarn-application-status-in-the-amazon-emr-console/
    • Custom AMIs: https://aws.amazon.com/blogs/big-data/create-custom-amis-and-push-updates-to-a-running-amazon-emr-cluster-using-amazon-ec2-systems-manager/
    • EMR Instance Fleets: https://aws.amazon.com/blogs/aws/new-amazon-emr-instance-fleets/
    • Auto Scaling EMR Clusters: https://aws.amazon.com/blogs/big-data/dynamically-scale-applications-on-amazon-emr-with-auto-scaling/
    • EMR Security Configurations: https://aws.amazon.com/blogs/big-data/encrypt-data-at-rest-and-in-flight-on-amazon-emr-with-security-configurations/
    • Responding To State Changes with AWS CloudWatch Events: https://aws.amazon.com/blogs/big-data/respond-to-state-changes-on-amazon-emr-clusters-with-amazon-cloudwatch-events/
    We have a big opportunity to change the way the industry thinks about Big Data analytics, and we need smart people to help us get there.

    The ideal candidate is passionate about cloud computing and about the opportunities surrounding AWS Big Data Services. This person has delivered high-quality technology products and services in a hyper-growth environment where priorities shift fast. The leader we are looking for brings proven experience building, managing, focusing, and mentoring engineering teams. Experience building and operating web-based applications and/or web services-based applications, especially at massive scale, is also very valuable.

    Ideal Candidates will:
    • Actively participate in hiring talented people and assist in the career development of others both on and outside your team, mentoring individuals and helping other managers guide the career growth of their team members.
    • Play a critical role in developing the broad plan for the business, working closely with senior executives to develop business targets and resource requirements. Help form long-term technical and business strategy and goals.
    • Bring a deep understanding of software development in a team, software development methodologies and scheduling, a track record of shipping software on time and services development to this high-accountability role.
    • Have experience operating services to deliver both high quality and high availability.
    • Possess strong verbal and written communication skills and demonstrate proven technical leadership.
    • Possess strong analytical skills with excellent problem solving abilities.
    • Have experience with distributed systems, experience building data processing solutions is a plus.
    • Demonstrate high levels of creativity and right judgments, most of the time.
    • Understand business context to decisions made within and across groups.
    • Contribute to Amazon's Intellectual Property through patents and/or external publications.

    For more information:
    • AWS re:Invent 2017 Amazon EMR: https://www.youtube.com/watch?v=1CAWf9VDgFM
    • AWS re:Invent 2017 Keynote - Andy Jassy: https://www.youtube.com/watch?v=1IxDLeFQKPk
    • AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/
    • AWS EMR: https://aws.amazon.com/emr/

    Amazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation

    Basic Qualifications

    • Have a minimum of 7 years of software development plus at least 2 years spent in a leadership/management role

    Preferred Qualifications

    • Possesses a strong understanding of the Big Data or HPC market
    • Is technically deep enough to engage with customers and participate in roadmap prioritization
    • Be technically adept in software development and experienced in the processes around it
    • Be experienced in using various software development methodologies
    • Have a proven track record of shipping high quality software on time
    • Have a minimum of 7 years of software development plus at least 2 years spent in a leadership/management role
    • Proven track record of building and managing high performing engineering teams
    • Experience with data processing systems such as Hadoop.
    • Experience with any of the popular relational databases and data warehouses.
    • Strong sense of ownership, urgency, and drive.
    • Demonstrated ability to achieve stretch goals in a highly innovative and fast paced environment.
    • BS/MS in Computer Science or equivalent
    Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
    Share this job