Staff Data Engineer - #19543892
SoFi runs on data! In this role you will be contributing to the long-term success of SoFi's big data vision of establishing a democratized data platform that enables teams to ingest, model, and consume data with confidence. Join the Big Data Infrastructure team as it refines this vision and establishes industry-leading standards for data lifecycle management ushering in best-in-class architectural components and processes in extracting value from disparate data sources. The success of this team is central to the success of the company and your contributions will have very visible and lasting impact.
As a staff engineer on the big data platform at SoFi, you'll be central in setting the technical direction of the team by contributing to architectural designs and providing technical documentation.. You will partner with engineering teams across the company to ensure that the team maximizes value to consumers of the platform. Leveraging your experience and deep technical knowledge, you will provide leadership in evolving testing and deployment strategies. You will mentor fellow team members sponsoring them as they tackle increasingly complex technical challenges. The ideal candidate has experience in building distributed systems and scalable data platforms used to build data lakes and near-real time analytics systems. Additionally, you will demonstrate SoFi's core value of getting to the truth and making principle-based decisions. If you like working on problems with tangible and lasting impact, we would love to have you in our team!
What you'll do:
Break new ground in creating the foundation for managing data at scale at SoFi
Set the technical direction of the team focusing directly on architectural design, code quality and system health
Design, build, and refine scalable, high-performance batch and stream data processing infrastructure
Partner with the product team by establishing engineering context for new product ideas and refining requirements and acceptance criteria.
Mentor team members by sponsoring them in increasingly complex projects and broadly evangelizing team standards and best practices
Investigate and drive adoption of new technologies, patterns, and practices
Collaborate and represent your engineering squad with cross-functional stakeholders
- Work with amazing product and business managers to identify strategic opportunities, set and measure KPIs, make data-driven recommendations, and drive informed actions.
What you'll need:
Bachelor's degree, ideally in a technical field
6+ years experience as a software Engineer
Strong leadership and communication skills
Skilled at producing quality technical documentation
A passion and instinct for data quality
Demonstrated ability to manage and evolve SDLC practices
Strong fundamentals of data structures, algorithms, and design patterns
Software development experience in Java, C/C++, or C#
Advanced proficiency with SQL and strong Python development skills
In-depth experience building solutions using public clouds (Azure, AWS, GCP)
Expertise in big data platforms and tooling (AWS, Snowflake, Kafka, Luigi, Hadoop, Hive, Spark, Cassandra, Airflow, etc).
- Experience working in a collaborative coding environment, refining designs together, working through code reviews and managing pull requests
Nice to have:
Prior experience with CI/CD (gradle, git, automated testing and deployments)
Experience and in-depth knowledge of open source distributed systems such as Hadoop, Spark, Zookeeper, etcd, Cassandra, Kubernetes
Data exploration and analysis experience using SQL/Python/R/Tableau. Experience surfacing insights using math/statistics/ML techniques
- Passion and curiosity for FinTech