Product AI Application Backend Engineer

As a Product AI Application Backend Engineer at Bybit, you will be a core builder of AI engineering capabilities, deeply integrating large language models with financial business scenarios to construct the backend AI service layer powering trading intelligence, smart risk control, compliance monitoring, and user services.

What you'll do

• Design and develop core AI backend services, including model gateway, Agent scheduling layer, and streaming inference services. Build high-concurrency, low-latency, horizontally scalable microservice architectures that meet production SLA requirements for AI-powered services.
• Develop Agent workflows and tool-calling systems on the Openclaw platform. Define tool registration and integration standards for internal systems such as trading engine, risk systems, and data platforms, ensuring call-level security and result integrity for financial scenarios.
• Own the development and iteration of AI backend services for core scenarios including intelligent customer service, risk signal detection, compliance analysis, and personalized services. Collaborate with algorithm teams to deliver end-to-end model integration, effectiveness validation, and performance tuning.
• Design and maintain data infrastructure required by AI applications, including session memory and long-term memory storage, knowledge base management and incremental update mechanisms, ensuring data consistency and retrieval quality.
• Establish full-chain LLM application tracing, prompt version management, and evaluation frameworks. Design automated LLM-as-Judge pipelines to continuously monitor output quality, hallucination rates, and business KPIs.

What you bring

• Proficiency in Golang or Java, with solid understanding of data structures, algorithms, and system design. Familiarity with RESTful API and gRPC interface design.
• 5+ years of backend development experience with production-level expertise in microservice frameworks such as Spring Boot or go-zero, message queues such as Kafka or RabbitMQ, caching with Redis, and relational databases such as PostgreSQL or MySQL.
• 1+ year of hands-on production experience building LLM applications or AI Agents, with demonstrated AI skills in Agent development and LLM toolchain integration. You can independently deliver AI feature modules end-to-end.
• Deep understanding of LLM capabilities and limitations including hallucination, context length, and reasoning. Hands-on experience with Prompt Engineering, Few-shot and Chain-of-Thought design, with the ability to independently craft and iterate prompt strategies for complex business scenarios.

What we offer

• Study Growth Fund to support your professional development and continuous learning
• Internal events including team-building activities, workshops, and events designed to promote collaboration and innovation
• Global collaboration as part of a diverse, international team working alongside colleagues from around the world
• Career advancement opportunities within a rapidly expanding global company
• Internal mobility to grow with us, with access to internal job opportunities to help build your career path

About Bybit

Established in 2018, Bybit is one of the world's leading cryptocurrency exchanges and digital financial platforms, serving over 80 million users across more than 200 countries and regions. Bybit delivers a seamless ecosystem across trading, payments, wealth management, custody, institutional services, and Web3, recognized as one of the most trusted and transparent platforms in the digital asset industry.