Senior Data Analyst – Clinical AI Evaluation & Responsible AI
| Company | Elsevier |
|---|---|
| Location | Pennsylvania, USA |
| Salary | $Not Provided – $Not Provided |
| Type | Full-Time |
| Degrees | Bachelor’s, Master’s, PhD |
| Experience Level | Senior, Expert or higher |
Requirements
- 6-9 years of relevant experience in data analytics with focus on AI/ML evaluation
- Bachelor’s degree required, Master’s or PhD preferred in Mathematics/Science
- Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
- Have experience in a data analytics role with focus on AI/ML evaluation
- Have expertise in creating evaluation frameworks for large language models and other AI systems
- Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
- Have expertise in using BI tools such as Tableau or PowerBI for AI performance visualization
- Be able to demonstrate experience using Python for AI model evaluation and output analysis
Responsibilities
- Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
- Leading and defining the strategic direction for AI evaluation methodologies in their product area
- Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
- Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
- Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
- Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
- Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts
Preferred Qualifications
-
No preferred qualifications provided.