Eightfold Matching Model

Background

In 2021, New York City passed a local law regulating “automated employment decision tools.” New York City regulators are working on rules to implement the law. Because of the high volume of public comments on this law, the regulators are planning additional public hearings and will not enforce the law until April 15, 2023.

Eightfold’s Matching Model

Eightfold’s cloud-based platform uses a model built using machine learning techniques. The model uses input data described below to produce a match score corresponding to a predicted degree of match between a job and a candidate, such as external job seekers or internal employees seeking promotion or other internal mobility.

The match score produced by the model ranges from 0 through 5 in increments of 0.5. The model helps predict the degree of match between a candidate and a job position to provide decision makers with objective information. It is not a stand-alone score for a candidate; rather, a match score will vary depending on the particular pairing of the candidate and the job position, as well as any changes and updates to the candidate information or the job position information. 

The use of the match score can produce a list of candidates for a given job position in a rank-list manner. The match score also provides candidates with the ability to view jobs that are matched to their skills on Eightfold-powered career pages.  

Eightfold provides data insights to support decision makers in Human Resource (HR) processes. The model does not replace human decision making. Regardless of the strength of a given match, candidates can apply for any open position and HR recruiting users can hire anyone they choose.

Inputs for the model

Eightfold’s model processes information obtained from both the job position and the candidate. The model works with job related information such as titles, work experiences, education, skills, and natural language of resumes and job descriptions. The job position information may include the employer’s job descriptions, job postings, or inputs provided by an employer representative such as desired skills, experience, or education. The candidate typically provides a resume or a job application that conveys work history, education, skills, and so on. 

These inputs are provided by individuals such as candidates or recruiters, or databases/systems such as an employer’s applicant tracking system (ATS) or human resources information system (HRIS). The input data may be accessed from the employer’s cloud-hosted systems. For instance, employers who are Eightfold customers can provide job and candidate information by integrating their IT systems with Eightfold’s platform. The input data may also include career information provided through Eightfold’s platform from publicly or commercially available data to provide the employer with up-to-date candidate information. Eightfold’s Privacy Policy has additional details regarding personal data we process on behalf of Eightfold’s customers.

Viewing match score outputs

Using the data inputs described above, the model produces a match score between a given job and a given candidate. Eightfold’s platform can display to employer users the match score of the position-candidate pair and can also provide explanations on how the model derived the score. These explanations include concise breakdowns on how well a candidate profile matches the requirements of the job, including for example skill relevance, work relevance, and job title relevance. 

When reviewing each position and candidates for the position, the employer representative can use the model output to help understand the specific skills, titles, work, and job title relevance of each candidate for the position. The reviewer can hover over a given candidate to see the breakdowns and can also click to view the candidate’s work experiences. The reviewer can view candidates in any order and can choose actions regardless of the display of the model output.

When visiting an Eightfold-powered career site, a candidate can upload a resume and view jobs that may be a good match. The display is designed to surface more opportunities to the candidate based on objective information. The candidate may choose to apply or not apply to any of the jobs surfaced and may search for additional ones to examine.

Bias audit

Eightfold completed a third-party bias audit of the Eightfold Matching Model. An independent auditor, BABL AI

A summary of the results of this audit is available, on request, to Eightfold customers. 

Eightfold will continue to follow developments from the New York City Department of Consumer and Worker Protection, the regulators responsible for the rules to implement the law. If these rules require changes to our bias audit, we will update accordingly. We anticipate sharing our bias audit publicly before April 15, 2023, the currently-scheduled date of enforcement of the law.