Sr. Software (Big Data) Engineer

Santa Clara, California


Sr. Software Engineer – Big Data

Job Description

You will be part of an enterprise Big Data Team. The big data team is responsible for:

-Collecting, storing and real-time access to large amounts of data

-Provide real time analytic tools and reporting capabilities for various purposes including:

  • Monitoring, alerting and troubleshooting
  • Anomaly detection
  • Capacity planning
  • Data analytics


As a Senior Software Engineer you will be responsible for;

  • Hands-on Full Stack Big Data Senior Engineer role responsible for building the our next-generation libraries, APIs and data pipelines for Bigdata team
  • Develop data engineering components and applications and entities to empower self-serve of bigdata products
  • Lead complex and technically challenging projects from concept to completion
  • Assist in developing UI components to enhance our in-house visualization tool



  • 7+ years of software development experience
  • 5+ years in designing and building scalable reusable products / components
  • 5+ years programming experience in Java
  • Strong understanding of Object Oriented Analysis and Design, Algorithms and Data Structures
  • 5+ years in building and maintaining ETL pipelines using Bigdata technologies like Spark Streaming, Spark SQL, MapReduce, Kafka and Hive/Impala and Hadoop
  • Professional experience defining, developing and maintaining scalable web service API
  • Expert skills working with SQL queries, including performance tuning, utilizing indexes/partitions, and materialized views to improve query performance.
  • Exceptional in database design & development, writing optimized SQLs
  • SQL friendly data structures
  • Experience working with JavaScript libraries such as ReactJS, Backbone.js, Node.js, jQuery.
  • Exceptional debugging, testing, and problem-solving skills.
  • Able to troubleshoot systems integration and performance issues
  • Self-motivated and eager to absorb new emerging technologies
  • Exceptional written and verbal communication skills with proven ability to effectively communicate complex technical issues to both technical and non-technical teams.
Proven Recruiting