TitleSenior Hadoop Engineer
State/ProvinceDC Metro Area
Avalon Consulting, LLC is seeking a Senior Hadoop Engineer/Architect to act as a consultant with clients through the design, development, installation, and securing of Big Data solutions.  Preferred locations include Dallas/DFW, Austin, Chicago, Denver or Minneapolis.  However, Avalon is open to candidates in all major US cities.  Candidates will travel to various client sites based on needs.                                                                                                                                                                                                                                                                                                             
Summary Description:
As a Senior Hadoop Engineer/Architect, you will solve problems for clients using Big Data and Hadoop ecosystem technologies. You will help them select the appropriate Hadoop, NOSQL and Search components to use, design a solution to solve their business and technical problems, and then present your solution to the client.  Furthermore, the consultant will be responsible for deployment or conversion of the solution with aligned security controls.
Job Duties:
  • Perform structured data analytics on Hadoop using various methods for SQL on Hadoop including Hive, Impala and Spark SQL - experience with other Spark components is a plus
  • Integrate Hadoop with existing RDBMS systems to implement two-tiered EDW & ETL solutions offloading data and processing to achieve the best cost-benefit for the overall system
  • Implement and train machine learning algorithms using big data to help understand and use large datasets
  • Consult with client to address data governance and security requirements
  • Perform performance tuning
  • Perform POC deployments and conversions
  • Install technical security controls
  • Select the right approach of technology depending on data type and latency requirements for batch, interactive and streaming data analytics 
  • Train clients in usage and features of big data technologies, through in-person training sessions, speaking at conferences, and blog posts
  • Administer solutions for clients