Lead Software Engineer - Data Infrastructure

  • BHO Tech
  • San Francisco, CA, USA
  • Jul 08, 2024
Full time Engineering

Job Description

Be one of the founding members of our data team and develop our next gen data platform. Help us build scalable distributed systems like you’d construct additional pylons in your base. You build those in your sleep, amirite?

What you'll be doing 
-You’ll be one of the first members of our Data team. Build the vision and help define the architecture of our new Data platform. 
-Help us build a robust and scaleable foundation for data, from logging to streaming pipelines, ETL & data consumers. 
-Own and operate our entire data stack using modern technologies such as Apache Beam, Pub/Sub and Airflow. 
-Work closely with our engineers, data scientists and analysts to optimize our data pipelines and establish best practices for table schemas, data models and data storage. 
-Build efficient solutions on top of GCP and AWS using Python, Scala and Go.

What you should have 
-Minimum of 4 years experience building scalable backend systems. 
-Experience working on, and deploying, large scale systems in Python, Go, Scala/Java, or other similar languages. 
-Experience working with and managing varied forms of distributed data systems such as Kafka, Storm or Spark. 
-Love to work with high volume heterogeneous data and distributed systems. 
-Self-motivation and the ability to take a high-level goal and deliver shippable code.

Bonus Points 
-Proven track record of working with terabyte or petabyte-scale data infrastructure. 
-Love to work with high volume heterogeneous data and distributed systems. 
-Experience working with varied data applications and databases, such as Hadoop, Druid, Spark or Redshift. 
-Expert knowledge of SQL, MapReduce and/or statistics scripting tools (i.e. R). 
-BS/MS/PhD in Computer Science, Applied Mathematics or a related field. 
-Godlike pylon construction skills.

Skills

Python, Java, Hadoop, SQL, Scalable Systems, Distributed Systems, Mapreduce, Scalability, Scala, Kafka, Amazon Redshift, Apache Spark, Druid, Apache Storm, Go

Compensation

$190K – $250K and higher (DOE)
0.001% – 0.2%

Visa Sponsorship

Available


Best Regards,
Kris
Kris Young
Account Manager
BHO Tech
San Jose, San Francisco CA
Phone: 866 816-1615 x 823
kris@bhotech.com
www.bhotech.com