Activision recently published a comprehensive 25-page paper discussing the effects of skill-based matchmaking (SBMM) in Call of Duty multiplayer games. The paper, titled “Matchmaking Series: The Role of Skill in Matchmaking,” aimed to understand the impact of SBMM, a system designed to match players with opponents of similar skill levels.
The findings revealed that maintaining SBMM is beneficial for the majority of players, despite some controversy surrounding the system.
During the research, Activision conducted an experiment where they progressively disabled SBMM to monitor player retention and satisfaction. The results were clear: without SBMM, players were more likely to quit games early, played less frequently, and had more negative experiences.
The company noted that while playing against better opponents might theoretically improve player skills, in practice, it led to frustration and decreased engagement.
The paper highlights that SBMM is not the sole factor in matchmaking but plays a significant role in ensuring a balanced and enjoyable experience for players. Activision’s testing showed that severe mismatches in player skills resulted in higher quit rates and reduced enjoyment. This finding underscores the importance of maintaining a level playing field to keep players engaged and satisfied with their gaming experience.
Despite the strong evidence supporting SBMM, Activision is considering introducing a multiplayer playlist without skill-based matchmaking. However, their historical data suggests that lower and mid-skill players would likely avoid such a playlist, indicating a limited appeal. This consideration shows Activision’s ongoing commitment to exploring various matchmaking approaches to enhance player satisfaction.
Ultimately, Activision’s research supports the continuation of SBMM in Call of Duty multiplayer. The system not only helps players contribute meaningfully to their teams but also prevents the frustration associated with lopsided matches. The company plans to conduct further experiments later this year, indicating that they are open to refining their matchmaking strategies based on player feedback and new data.
