AI Quality & Performance Analyst
Description

At Mark-Taylor, we believe our success starts with our people. For over 40 years, we’ve built and managed Arizona’s most beautiful apartment communities while fostering a culture centered on people, excellence and growth. 


We are proud to be recognized as Ranking Arizona’s #1 Multifamily Builder and Manager, a Best Place to work in Multifamily, and a Healthiest Employer by the Phoenix Business Journal, and more. 


Our communities are growing and so is our corporate team! We’re hiring an AI Quality & Performance Analyst at our corporate office in Scottsdale, AZ.  


Why You’ll Love working at Mark-Taylor

  • Employee rent discounts.*
  • Access to all Mark-Taylor amenities.
  • Employee appreciation events. 
  • Opportunities for career growth. 
  • 401(k) with robust company match.**
  • Paid time off, sick time, holidays, and volunteer time.**
  • Comprehensive Medical, Dental, and Vision benefits.**


Requirements
  • Three or more years of relevant experience in quality assurance, customer experience, software testing, operational analytics, process improvement, or a related discipline.
  • Strong judgment and the ability to evaluate ambiguous AI outputs against documented standards.
  • Excellent analytical, written communication, and problem-solving skills.
  • Experience creating scorecards, analyzing trends, documenting defects, and coordinating improvements across teams.
  • Working knowledge of generative AI, including inaccurate responses, inconsistent behavior, and limitations of automated evaluation.
  • Ability to work with recordings, transcripts, generated content, CRM records, dashboards, and workflow histories.
  • Multifamily leasing, resident services, or centralized operations experience preferred.
  • Experience with AI evaluation tools, conversation analytics, SQL, or workflow automation preferred.


In this role, you will

  • Review AI-generated conversations, content, recommendations, and related system activity for accuracy, completeness, clarity, relevance, professionalism, and resolution of user needs.
  • Verify that AI completes requested or promised actions correctly, including scheduling appointments, recording requests, updating information, and routing work.
  • Assess voice and messaging experiences for delays, interruptions, speech recognition and pronunciation issues, repeated questions, conflicting answers, lost context, duplicate outreach, and incomplete handoffs.
  • Maintain quality scorecards, examples of acceptable and unacceptable behavior, issue severity definitions, and escalation procedures. Establish quality baselines and recommend performance targets.
  • Combine random sampling with targeted reviews of higher-risk interactions. Validate automated evaluations against human review and verified system outcomes.
  • Investigate and document root causes involving source information, AI instructions, workflow configuration, integrations, speech recognition, or model behavior.
  • Maintain a prioritized issue backlog, coordinate fixes with responsible teams and platform partners, and verify that fixes address the underlying problems and hold up over time.
  • Maintain a reusable test library. Test new capabilities and changes before release and confirm existing functionality still works.
  • Evaluate AI against company-approved fair housing, privacy, sensitive information, emergency routing, and brand standards. Escalate exceptions to designated owners and track critical policy exceptions separately.
  • Escalate critical failures immediately and recommend holding a release or restricting an affected capability when warranted.
  • Report quality trends, recurring failures, improvement priorities, and verified results. Measure the impact on leasing, resident service, employee productivity, operational efficiency, and team capacity.



Mark-Taylor is an equal opportunity employer and a drug-free workplace. All our employees undergo pre-employment screening which includes drug testing.


*Housing discounts are subject to availability at each community. 

**Benefits offered for full-time employees.