Lead AI Platform Engineer Description

We are a boutique hedge fund seeking an AI Platform Engineer to spearhead the build out of a new, internal data lake and platform. This is a hands-on technical leadership role where you'll build AI-powered systems and onboard/manage a small team.

Design and build a data lake processing market data, SEC filings, and alternative data sources. The platform will use ML analytics and natural language interfaces to make information instantly searchable.

Technical Leadership

• Design data platform architecture with ingestion pipelines, storage layers, and modern stacks.
• Build ML workflows for automated analysis and pattern recognition
• Integrate RAG, LLMs, and AI tools for document processing and querying

Team Management

• Hire and onboard/manage 3-5 specialists: data engineers, backend system specialists, platform developers
• Work with the existing team to integrate new capabilities and manage project deliverables

Required Experience

• 6+ years building ML data platforms with model deployment and feature engineering experience
• Advanced SQL, Python, Cursor, distributed computing with database scaling expertise
• Team leadership and project delivery experience
• Proven track record evaluating and selecting optimal technology stacks
• Working knowledge of RAG, LLM integration, and Llama open-source tools

You'll leverage and enhance our internal IP and time-tested processes to extend our 30-year winning track record in public markets.

• Competitive salary plus equity participation in fund performance
• Full technical authority with executive backing
• Budget for team hiring and technology investments
• Opportunity to build from scratch at a profitable, growing fund

We need someone who can start immediately and take ownership of this project. The ideal candidate has built similar platforms and is excited about applying ML to financial data.

San Francisco-based, full-time position with comprehensive benefits and collaborative work environment.