Senior Staff Analyst – Model Risk Management – AI Model Specialist
| Company | SoFi |
|---|---|
| Location | San Francisco, CA, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s, Master’s, PhD |
| Experience Level | Senior |
Requirements
- Strong analytical skills with formal training in statistical analysis
- Prior experience with the model risk management function in a banking environment
- High familiarity with generative AI models; knowledge of both theory and best practices for managing usage risk
- Strong writing skills; ability to communicate technical concepts in understandable terms
- Proficiency in Python or R
- Self-starter who is comfortable autonomously conducting a complete model validation project including developing the validation plan
- 6+ years of related experience with a Bachelor’s degree in a quantitative discipline; or 3 years and a Master’s degree; or a PhD without experience; or equivalent experience
Responsibilities
- Perform critical reviews of (or “validating”) generative AI (large language) models and proposed use cases for such models
- Read model documentation and engage in dialogue with model developers (or vendors) to understand how the model was built and how it functions
- Assess the suitability of data used to build the model, the conceptual soundness and orthodoxy of the modeling approach, and the appropriateness of the testing protocols and diagnostic metrics used on the model
- Review results of diagnostic testing and analysis performed by the developer and by prospective users and conduct confirmatory or additional testing as needed
- Summarize work and findings in a detailed written report, which will include formal recommendations and any required remediation work
Preferred Qualifications
-
No preferred qualifications provided.