5 days old

Director, Data Lake Solutions Architecture

Capital One
McLean, VA 22101
7900 Westpark Drive (12131), United States of America, McLean, Virginia

At Capital One, were building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.                                               

Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.

Director, Data Lake Solutions Architecture

Do you have a passion for architecting solutions that leverage the latest technologies to deliver secure, reliable, resilient and scalable data management solutions? Capital One is seeking a Director, Data Lake Solutions Architecture to transform ourdataecosystem. Acting as an internal consultant to business and information technology delivery teams, the ideal candidate willarchitectand design solutions that are strategic for the business and built using the latest technologies and techniques. Utilizing in-depth knowledge of infrastructure, open source technologies anddataengineering, you will develop the strategy, achieve business and engineering buy-in, and monitor execution toward the target architecture across the enterprise.

Responsibilities:

  • Define, execute and continuously improve our internal softwareand data architecture processes

  • Set technical strategy, applying an in-depth understanding of the business strategy governing that area

  • Design and develop cutting-edge data solutions, using existing and emerging technology platforms

  • Leverage sound judgment and problem solving to tackle some of Capital Ones most critical data problems and connect the dots to broader implications of the work

  • Build awareness, increase knowledge and drive adoption of modern data technologies and architecture patterns, sharing customer and engineering benefits to gain buy-in

  • Architect data lake solutions using AWS technologies including S3

  • Design data manipulation and access patterns for Parquet and Avro

  • Promote a culture of data engineering and architecture excellence and being well-managed, using opportunities to reuse and innersource solutions where possible

  • Design of access control of the data in the lake using IAM roles and STS tokens

  • Develop integration patterns with Kafka messages and schemas

  • Effectively communicate with and influence key stakeholders across the enterprise, at all levels of the organization

  • Develop hooks to Hive metastore and integrating with Glue

Basic Qualifications:

  • Bachelors Degree

  • At least 8 years of experience designing, developing, and architecting enterprise data systems

  • At least 5 years working with data tools MongoDB, Hadoop, Cassandra, Spark or NoSQL

  • At least 5 years of public cloud (AWS, Azure, or GCP), ETL tools, and metadata repositories

Preferred Qualifications:

  • Masters Degree or higher in Computer Science or a related field

  • 10+ years of building large scale data systems

  • 7+ years of influencing leadership in the fields of database, data warehousing or data sciences

  • 5+ years of using AWS ecosystem tools

  • 5+ years of Apache, Spark, or Hadoop and data analytics ecosystem relevant tools (Sqoop, Flume, Kinesis, Kafka, Oozie, Hue, Zookeeper, Ranger, Elasticsearch, and Avro)

  • 3+ years with data lake technologies S3, Lake Formation, Athena, Glue and Metastore

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.


Categories

Posted: 2020-05-20 Expires: 2020-06-19

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Director, Data Lake Solutions Architecture

Capital One
McLean, VA 22101

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast