The Opportunity
“As a Staff Applied AI Engineer on our newly formed Generative AI team, you will work at the frontier of language model applications, developing novel solutions for various areas of the FICO platform to include fraud investigation, decision automation, process flow automation, and optimization. You will play a critical role in ensuring robust operation, scalability, and governance of AI systems across our platform. You will have the opportunity to make a meaningful impact on FICO’s platform by infusing it with next-generation AI capabilities. You’ll work with a dedicated team, leveraging your skills in AI and machine learning to build solutions and drive innovation forward.” - Software Engineering – VP.
What You’ll Contribute
- Design and implement cutting-edge LLM-powered solutions for decision automation, fraud investigation, and process automation within FICO’s platform.
- Develop sophisticated prompting strategies and Retrieval-Augmented Generation (RAG) architectures tailored to high-stakes applications.
- Apply advanced fine-tuning, in-context learning techniques, and custom evaluation frameworks to optimize AI model performance.
- Build robust model evaluation and governance systems, ensuring compliance and reliability across applications.
- Design and execute comprehensive backtesting methodologies to validate model predictions and performance.
- Implement A/B testing frameworks to evaluate the impact of various AI interventions on system performance.
- Monitor model performance and detect drift to maintain high accuracy and relevance over time.
- Research and integrate the latest AI techniques to keep FICO’s platform at the forefront of innovation.
- Evaluate new models, architectures, and training approaches, experimenting with emerging technologies to enhance platform capabilities.
- Develop custom RAG implementations to enhance information retrieval within decision processes.
- Write production-quality code, implementing machine learning systems with attention to scalability, reliability, and security.
- Design scalable architectures that support FICO’s analytics and decisioning solutions.
- Implement advanced monitoring techniques and system reliability checks to maintain operational excellence.
What We’re Seeking
- 5+ years of industry experience in software, ML or data engineering, with a history of managing complex, large-scale projects and driving strategic technical decisions.
- Proficiency in Python, Go, Java, or similar languages.
- Experience with PyTorch, JAX or similar deep learning frameworks.
- Proficiency in fine-tuning, model adaptation, and customization.
- Solid foundation in machine learning evaluation and testing methodologies, including the development of custom evaluation frameworks.
- Knowledge of backtesting methodologies to ensure reliability and robustness of model predictions.
- Proven expertise in applying modern Large Language Models (LLMs) and their applications to real-world problems preferred.
- Strong skills in prompt engineering and chain-of-thought prompting techniques.
- Experience with Retrieval-Augmented Generation (RAG) architectures and familiarity with vector databases preferred
- Experience with A/B testing frameworks.
- Expertise in model monitoring, drift detection, and governance to maintain compliance and operational integrity.
- Familiarity with compliance and regulatory technology, particularly in AI-driven decisioning environments
- Strong software engineering fundamentals, with experience in writing production-quality code and designing scalable architectures.
- Proven ability to mentor teams and collaborate across departments to deliver high-impact solutions.
- Experience in fast-paced environments, with an ability to adapt and drive impact in high-growth, high-stakes settings.
- Publications, patents, or open-source contributions that showcase thought leadership and technical expertise in AI and machine learning.
- Bachelor’s or master’s degree in computer science, or a related field with focus in Machine Learning.
Our Offer to You
- An Inclusive Culture: Experience a work environment that embodies our core values: Act Like an Owner, Delight Our Customers, and Earn the Respect of Others.
- Growth and Development: Leverage your unique strengths and enjoy opportunities to make a meaningful impact while participating in valuable learning experiences for professional growth.
- Competitive Compensation and Benefits: Receive a highly competitive salary, benefits, and rewards program designed to recognize your contributions and encourage you to bring your best every day.
- Work-Life Balance and Community: Enjoy an engaging, people-first environment that supports work-life balance, with employee resource groups and social events to foster connection and camaraderie.
- Compensation Range: The targeted base pay range for this role is $161,000 to $253,000, reflecting variations in candidate knowledge, skills, and experience.