Senior Data Engineer

  • BHO Tech
  • San Francisco, CA, USA
  • Apr 23, 2021
Full time Engineering

Job Description

Would you like to join one of the fastest growing startups in San Francisco? Do you want an opportunity to deliver strategic and tactical influence regarding the application of Big Data technologies with us? We are a recent DEMO Traction Award Winner – is the world’s leading browser-based call center software solution. We have awesome investors, a superb team and we’re looking for an experienced Data Engineer that will steer development of a highly scalable and extensible real time and batch oriented data pipeline for collection, storage, processing, and analysis of large sets of data from multiple data sources including our real-time communications platform. You will be responsible for choosing an optimal solution to use for these purposes, then maintaining, implementing, and monitoring them. You will have an opportunity to work with and grow a team of other data enthusiasts.


Responsibilities

Selecting, integrating and building any Big Data tools and frameworks required to provide requested capabilities: ex Storm, Hadoop, etc 
Implementing ETL process 
Monitoring performance and advising any necessary infrastructure changes 
Defining data retention policies and capacity planning 
Work closely with product managers, data analysts, user experience experts, and quality engineers to build new features to empower our business through data

Skills and Qualifications

Proficient understanding of distributed computing principles 
Proficiency with building stream-processing systems, using solutions such as Storm or Spark-Streaming 
Proficiency with Hadoop, MapReduce, HDFS 
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala 
Experience with integration of data from multiple data sources 
Experience with NoSQL databases, such as MongoDB, Cassandra, HBase 
Strong SQL knowledge 
Knowledge of various ETL techniques and frameworks, such as Flume 
Experience with various messaging systems, such as Kafka or RabbitMQ 
BS or MS in Computer Science, Computer Engineering or other related discipline 
Nice to Have:

Experience with Big Data ML toolkits, such as Mahout, SparkML or H2O 
Good understanding of Lambda Architecture, along with its advantages and drawbacks 
Experience with Cloudera/MapR/Hortonworks 
Management of Hadoop, Storm clusters with all included services 
Ability to solve any ongoing issues with operating the cluster

Compensation

$50K – $130K and higher (DOE)
0.0% – 0.001%

Visa Sponsorship

Not available

Best Regards,
Kris
Kris Young
Account Manager
BHO Tech
San Jose, San Francisco CA
Phone: 866 816-1615 x 823
kris@bhotech.com
www.bhotech.com