AI Agents Challenge

Powered by WRKDN

Dataset Questions Overview

Our benchmark evaluates AI agents on five distinct datasets, each with its own theme and question types. Below you can explore the focus of each dataset and the types of questions agents need to answer.

Dataset 1: CRM Basics

This dataset focuses on basic CRM functions and data structures. AI agents are evaluated on their ability to understand standard CRM concepts and perform simple operations.

  • Contact management fundamentals
  • Basic sales pipeline operations
  • Simple customer data queries
  • Understanding CRM terminology

Dataset 2: Lead Management

This dataset evaluates an AI agent's ability to handle lead qualification, lead scoring, and conversion workflows.

  • Lead scoring and prioritization
  • Lead source analysis
  • Conversion rate calculations
  • Lead nurturing workflow design

Dataset 3: Sales Analytics

This dataset tests an AI agent's capability to analyze sales data, identify trends, and generate actionable insights.

  • Revenue forecasting
  • Sales cycle analysis
  • Performance metrics calculation
  • Opportunity pipeline analysis

Dataset 4: Customer Success

This dataset evaluates how well AI agents can understand customer health metrics and recommend retention strategies.

  • Churn risk identification
  • Customer health scoring
  • Renewal forecasting
  • Customer lifecycle management

Dataset 5: Executive Insights

This advanced dataset challenges AI agents to synthesize high-level insights for executive decision makers, focusing on strategic business planning and performance analysis.

  • Board-level reporting synthesis
  • Market position analysis
  • Cross-functional performance metrics
  • Strategic growth opportunity identification
  • Competitive landscape assessment

Each dataset also includes general sales knowledge questions that test an agent's understanding of sales methodologies, best practices, and industry concepts without relying on the provided data.

Question Examples

Below are a few sample questions from our datasets to give you an idea of the types of challenges your AI agent will need to handle.

Dataset 1 • Sales Pipeline Analytics
How many deals are currently in the Negotiation stage, and what is the total Amount of those Negotiation deals?
Category: pipeline_insights
Dataset 2 • Email Communication Analysis
What is the sentiment of this email thread (e.g. positive, neutral, or negative), and what key concern is the customer expressing?
Category: email_analysis
Dataset 3 • Sales Operations & Forecasting
Which opportunities should be flagged as at-risk, and why?
Category: general_sales_knowledge
Dataset 4 • Sales Performance Rules
Rule 1 (Send follow-up emails within 3 days): List 5 sales reps who always follow this rule.
Category: general_sales_knowledge
Dataset 5 • Sales Team Performance Analysis
What performance trend do you observe over the year, and what might this imply for the next quarter's focus or targets?
Category: employee_performance