Data Engineer

With a career at The Home Depot, you can be yourself and also be part of something bigger.

For this role, we are looking for someone who can design, build, and maintain the data models, transformations, and pipelines that turn raw contact center data into trusted metrics and datasets in a cloud-based data warehouse. This person will own metric logic and data quality, partner with operations and enterprise data teams, and hold source system owners to quality standards in support of Customer Solutions and Data Science initiatives that drive better customer experiences and more profitable outcomes.

• →20% Implement a real time streaming data ingestion and processing pipeline using Google Dataflow (Apache Beam)
• →20% Interface with business intelligence analyst and others in IT (i.e. data engineers, architects, WebOps) in frequent whiteboard sessions to discuss the design, implementation, and testing of data pipelines
• →20% Maintain data architecture standards and ETL/ELT best practices consistent with a column oriented data store in an analytic use case
• →20% Active and engaged participation in the Scrum delivery process
• →20% Support solutions in production

• Position Reports to Sr Mgr. of EDW
• This position has 0 direct reports

• Typically requires overnight travel less than 10% of the time.

• Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.

• Must be eighteen years of age or older.
• Must be legally permitted to work in the United States.

• Familiarity with Agile methodologies
• Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies
• Experience with data science technologies such as SAS, R, Matlab, or similar
• Experience with data warehousing and dimensional modeling

• Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

• The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

• No additional education

• No additional years of experience

• None

• 6

• None

• None

• Experience in building real time streaming data ingestion and processing pipeline using Apache Beam (running on either Google Datflow or Apache (Apex, Flink, or Spark) or Kafka in an analytics or data science use case
• Experience with data processing tools (e.g. Hadoop, Spark, Dataflow, etc.)
• Experience building ETL/ELT pipelines
• Experience with column-oriented databases (e.g Redhift, BigQuery, Vertica)
• Ability to go from whiteboard discussion to code
• Ability to effectively communicate with technical and non-technical audiences
• Strong programming ability
• Success in a highly dynamic environment and ability to shift priorities with agility
• Ability to act independently with minimal supervision
• Willingness to explore and implement new ideas and technologies
• Experience working directly with subject matter experts in both business and technology domains
• Experience as a team lead

For California, Colorado, Connecticut, Rhode Island, Nevada, New York City, Ithaca (NY), Westchester County (NY), and Washington residents: