Senior Software Engineer, Data Platform

As a Senior Software Engineer on the Data Platform team at TRM Labs, you will build and maintain mission-critical systems that analyze blockchain transaction activity at petabyte scale. You join an experienced group of data scientists, engineers, and product managers to create highly available and scalable data infrastructure that enables TRM's AI-powered intelligence solutions for public and private sector agencies investigating and disrupting crime.

What you'll do

• Build highly reliable data services to integrate with dozens of blockchains.
• Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
• Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
• Oversee the deployment and monitoring of large database clusters with a focus on performance and high availability.
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM's products.
• Build scalable engines to optimize routine scaling and maintenance tasks, enabling self-serve automation for creating new pgbouncer instances, scaling disks, and scaling or updating clusters.
• Identify ways to compress timelines using the 80/20 principle, prioritizing must-haves for operational readiness before adding additional features.
• Identify first versions, or "skateboards," for projects, building minimum-viable solutions and iterating based on stakeholder feedback.

What you bring

• A Bachelor's degree in Computer Science or a related field.
• 5+ years of hands-on experience architecting distributed system architecture, guiding projects from initial ideation through successful production deployment.
• Exceptional programming skills in Python, plus competence in SQL or SparkSQL.
• In-depth experience with data stores and engines such as Iceberg, Trino, BigQuery, StarRocks, and Citus.
• Proficiency in data pipeline and workflow orchestration tools like Airflow and DBT.
• Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
• Competence in deploying and monitoring infrastructure within public cloud platforms, using tools such as Docker, Terraform, Kubernetes, and Datadog.
• Proven ability in loading, querying, and transforming extensive datasets.
• AI fluency, demonstrated by applying AI to accelerate workflows, structure and solve problems, improve output quality, and increase speed and leverage.

About TRM Labs

TRM Labs provides AI-powered intelligence solutions that help public and private sector agencies investigate and disrupt crime. A Series C company with $220M in total funding backed by Goldman Sachs, Bessemer, Y Combinator, Thoma Bravo, and others, TRM is headquartered in San Francisco and operates as a distributed-first company with hubs in Los Angeles, San Francisco, New York, Washington D.C., London, and Singapore.